{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9c1138bb-efd5-57a4-b93f-715a7f57bb9c","task_key":"all--test--9c1138bb-efd5-57a4-b93f-715a7f57bb9c","task_revision_id":"1","upstream_id":"","short_description":"Sociologists like Bordo (1993) have attributed the 'epidemic' of anorexia in…","config":"all","split":"test","body":"{\"choices\":\"['a generally ascetic, frugal lifestyle that can be taken to extremes', 'traditional images of women as emotional, domesticated, and unassertive', \\\"the social construction of mental illness, through which 'normal' patterns of behaviour are pathologized\\\", 'the new ideal of independent, self-assured femininity, combined with cultural values of achievement and control']\",\"question\":\"Sociologists like Bordo (1993) have attributed the 'epidemic' of anorexia in Western cultures to:\",\"subject\":\"sociology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}