{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"207a6a2e-5dec-5d78-aa2c-7c68f3c878f4","task_key":"all--test--207a6a2e-5dec-5d78-aa2c-7c68f3c878f4","task_revision_id":"1","upstream_id":"","short_description":"In the 1960s, comprehensive schools did not eradicate class inequalities in…","config":"all","split":"test","body":"{\"choices\":\"['they tended to recruit pupils from the inner cities and traditionally working class areas', \\\"selective schools could still 'cream off' the most able pupils, while the comprehensives put children into ability streams\\\", 'teachers in comprehensive schools used the restricted code in the classroom, whereas working class pupils used elaborated codes of speech', 'national testing and league tables made the new schools highly competitive and selective']\",\"question\":\"In the 1960s, comprehensive schools did not eradicate class inequalities in education because:\",\"subject\":\"sociology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}