{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"879fbf6e-a301-534d-8e04-a792b41336a2","task_key":"all--test--879fbf6e-a301-534d-8e04-a792b41336a2","task_revision_id":"1","upstream_id":"","short_description":"How does Nozick answer the criticism of his historical entitlement theory that…","config":"all","split":"test","body":"{\"choices\":\"['It can be remedied by redistribution of wealth.', \\\"If each person's holdings are just, then the total distribution of holdings is just.\\\", 'Historical factors are secondary to moral imperatives.', 'He has no answer.']\",\"question\":\"How does Nozick answer the criticism of his historical entitlement theory that if the distribution of goods in society is unjust those at the bottom always lose?\",\"subject\":\"jurisprudence\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}