{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b2a35e8-fc5c-5e9a-a46a-701965044bd6","task_key":"all--test--6b2a35e8-fc5c-5e9a-a46a-701965044bd6","task_revision_id":"1","upstream_id":"","short_description":"In a study of brain development, two groups of rats were reared in a laboratory…","config":"all","split":"test","body":"{\"choices\":\"['The rats raised in Group I will have forebrains that weigh more than those of the rats raised in Group II.', 'The rats raised in Group I will have forebrains that weigh less than those of the rats raised in Group II.', 'The brains of the rats raised in Group I will not be noticeably different from the brains of the rats raised in Group II.', 'The brains of the rats raised in Group I will consist of more white matter, while the brains of the rats raised in Group II will consist of more gray matter.']\",\"question\":\"In a study of brain development, two groups of rats were reared in a laboratory setting. In Group I, each rat was raised in isolation with no toys, while in Group II, rats were divided into small groups and given toys to play with. Which of the following statements most accurately reflects the probable findings of this study?\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}