{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be8c736e-9485-5092-9bf3-3144f6e19c94","task_key":"all--test--be8c736e-9485-5092-9bf3-3144f6e19c94","task_revision_id":"1","upstream_id":"","short_description":"Collins suggests that the moral value of caring actions comes from","config":"all","split":"test","body":"{\"choices\":\"['the intrinsic value of caring attitudes which motivate caring actions.', \\\"how well any caring actions fulfills the recipient's interests and the strength of one's intention to fulfill the recipient's interest.\\\", 'the degree to which those actions produces the greatest amount of happiness in the recipient of care.', 'the non-instrumental value of caring actions as manifestations of intrinsic goods for person like love and forgiveness.']\",\"question\":\" Collins suggests that the moral value of caring actions comes from\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}