{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3407ac0a-3a55-58f8-91b4-f6e4ab04febe","task_key":"all--test--3407ac0a-3a55-58f8-91b4-f6e4ab04febe","task_revision_id":"1","upstream_id":"","short_description":"One of the key areas of debate in the early stages of Developmental Psychology…","config":"all","split":"test","body":"{\"choices\":\"['Sensitive period.', 'Secular trends.', 'Canalization?', 'Critical period.']\",\"question\":\"One of the key areas of debate in the early stages of Developmental Psychology was the so called, Nature vs. Nurture debate. Academics agreed that there was interaction between these two factors but there was wide disagreement concerning the degree of interaction. Which of the following terms, that relate to either genetic or environmentally caused changes, describes the differences in timing of physical changes that are found in children belonging to different cohorts?\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}