{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a2c051e4-35c7-5f4c-985e-545d02bcbc4d","task_key":"all--test--a2c051e4-35c7-5f4c-985e-545d02bcbc4d","task_revision_id":"1","upstream_id":"","short_description":"A 10-month-old boy is brought to the physician because of a 4-day history of…","config":"all","split":"test","body":"{\"choices\":\"['DNA genome', 'Double-stranded nucleic acid genome', 'Mature virion lacking viral polymerase', 'Mediation of cell entry via a fusion protein']\",\"question\":\"A 10-month-old boy is brought to the physician because of a 4-day history of fever and cough. His illness began with lowgrade fever and copious, clear nasal discharge. Two days ago he developed a moist, nonproductive cough and rapid breathing. He has received all scheduled childhood immunizations. He attends a large day-care center and has three schoolaged siblings. His temperature is 38°C (100.4°F), pulse is 101/min, respirations are 38/min, and blood pressure is 85/60 mm Hg. Physical examination shows nasal flaring and rhinorrhea. Chest examination shows intercostal retractions along with bilateral, diffuse wheezes and expiratory rhonchi. The infectious agent of this patient's condition most likely has which of the following properties?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}