{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"779487a3-bc95-5bb1-8f21-b53195a3a167","task_key":"all--test--779487a3-bc95-5bb1-8f21-b53195a3a167","task_revision_id":"1","upstream_id":"","short_description":"In contrast to Garrett Hardin's approach, the Confucian model rejects coercion…","config":"all","split":"test","body":"{\"choices\":\"['the costs of eliminating a collective action problem are not irrelevant to its solution', 'it affirms the autonomy of individuals apart from others.', 'it cannot lead to real social change, which involves changes of mind as well as action', 'The Confucian model actually accepts coercion.']\",\"question\":\" In contrast to Garrett Hardin's approach, the Confucian model rejects coercion because\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}