{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3bd652e-b916-5531-a54d-4b0d3c60e96c","task_key":"all--test--b3bd652e-b916-5531-a54d-4b0d3c60e96c","task_revision_id":"1","upstream_id":"","short_description":"Why do the Scandinavian realists reject a metaphysical approach to law?","config":"all","split":"test","body":"{\"choices\":\"['Because they regard empiricism as a more reliable method by which to understand the concept of law.', 'Because they have no interest in the operation of the legal system.', \\\"Because their approach is based on Bentham's sceptical account of the common law.\\\", 'Because they prefer a natural law analysis of legal ideas.']\",\"question\":\"Why do the Scandinavian realists reject a metaphysical approach to law?\",\"subject\":\"jurisprudence\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}