{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c47dbf22-f512-5432-bfc4-eba172348b75","task_key":"all--test--c47dbf22-f512-5432-bfc4-eba172348b75","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is true about any system that undergoes a reversible…","config":"all","split":"test","body":"{\"choices\":\"['There are no changes in the internal energy of the system.', 'The temperature of the system remains constant during the process.', 'The entropy of the system and its environment remains unchanged.', 'The entropy of the system and its environment must increase.']\",\"question\":\"Which of the following is true about any system that undergoes a reversible thermodynamic process?\",\"subject\":\"college_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}