{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c8d92726-9088-5e19-95d6-5d78e416c3db","task_key":"all--test--c8d92726-9088-5e19-95d6-5d78e416c3db","task_revision_id":"1","upstream_id":"","short_description":"One objection to care ethics is thatit seems to imply that we areresponsible for…","config":"all","split":"test","body":"{\"choices\":\"['caring attitudes are not moral attitudes at all.', 'we can often bring ourselves to have attitudes of care indirectly', 'when we fail to have attitudes of care this means that no caring attitudes were required of us towards some person', 'Collins agrees with the objection.']\",\"question\":\" One objection to care ethics is thatit seems to imply that we areresponsible for our attitudes, even though they seem not to be under our voluntary control. Collins responds by arguing that\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}