{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0a81663-3e70-5d77-8984-fdd75b71bff2","task_key":"all--test--e0a81663-3e70-5d77-8984-fdd75b71bff2","task_revision_id":"1","upstream_id":"","short_description":"In the context of Gardiner's article, \"the fragmentation of agency\" refers to…","config":"all","split":"test","body":"{\"choices\":\"[\\\"an agent's inability to acknowledge his or her contribution to climate change\\\", 'the fragmentation of the effects of greenhouse gas emissions across generations', 'the vast number of individuals and agents who contribute to climate change', \\\"the idea that it's not rational for each individual to restrict his or her own pollution\\\"]\",\"question\":\" In the context of Gardiner's article, \\\"the fragmentation of agency\\\" refers to what?\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}