{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5bd004c6-5904-5fdc-ab37-674000b70665","task_key":"all--test--5bd004c6-5904-5fdc-ab37-674000b70665","task_revision_id":"1","upstream_id":"","short_description":"Officials at a large community hospital report an increased incidence of acute…","config":"all","split":"test","body":"{\"choices\":\"['Children exposed to the chemical waste who do not suffer from ALL', 'Children not exposed to the chemical waste who do not suffer from ALL', 'Children from the hospital’s outpatient clinic who do not suffer from ALL', 'Children not exposed to the chemical waste who suffer from ALL']\",\"question\":\"Officials at a large community hospital report an increased incidence of acute lymphocytic leukemia (ALL) among children aged 5 – 12. They point out that some households in the community are exposed to chemical waste from a nearby factory. They believe that chemical waste causes leukemia. If a study is designed to evaluate the hospital officials’ claim, which of the following subjects are most likely to comprise the control group?\",\"subject\":\"virology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}