{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"29015312-721a-52f6-993b-b3c95c5ab173","task_key":"all--test--29015312-721a-52f6-993b-b3c95c5ab173","task_revision_id":"1","upstream_id":"","short_description":"The 'extension pattern' that Parker (1976) identified was said to be:","config":"all","split":"test","body":"{\"choices\":\"['the lifestyle of clerical and unskilled manual workers, who saw leisure time as a chance to escape from alienating work', 'characteristic of professionals and skilled workers, whose work interests spilled over into leisure time', 'a neutral balance between work and leisure as neither connected nor oppositional, as evidenced by semi-skilled manual and clerical workers', 'the tendency of students to leave essay-writing until the last minute and then ask for an extended deadline']\",\"question\":\"The 'extension pattern' that Parker (1976) identified was said to be:\",\"subject\":\"sociology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}