{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f9cfb8c3-aae2-5822-b0e2-bcf5aa40ecce","task_key":"all--test--f9cfb8c3-aae2-5822-b0e2-bcf5aa40ecce","task_revision_id":"1","upstream_id":"","short_description":"What is wrong with a conservation system based wholly on economic motives…","config":"all","split":"test","body":"{\"choices\":\"['It assumes that the economic parts of the biotic system will function without the uneconomic parts.', 'It assumes that economic motives are morally relevant.', 'It implies that nonhuman creatures are necessarily without any moral standing.', 'none of the above']\",\"question\":\" What is wrong with a conservation system based wholly on economic motives according to Leopold?\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}