{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7495018a-5ba3-5be8-afb6-eb1c47e36363","task_key":"all--test--7495018a-5ba3-5be8-afb6-eb1c47e36363","task_revision_id":"1","upstream_id":"","short_description":"What relationships to the type of law that exists in society does Durkheim…","config":"all","split":"test","body":"{\"choices\":\"['Mechanical solidarity produces conflict in society. Organic solidarity leads to greater social harmony.', 'Mechanical solidarity leads to repressive law. Organic solidarity leads to restitutive law.', 'Mechanical solidarity fosters efficiency. Organic solidarity leads to inefficiency.', 'Mechanical solidarity generates a more democratic legal system; organic solidarity a more authoritarian legal system.']\",\"question\":\"What relationships to the type of law that exists in society does Durkheim identify between (1) mechanical and (2) organic solidarity?\",\"subject\":\"jurisprudence\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}