{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2da82b73-66b0-58d6-90df-91ac3c812b71","task_key":"all--test--2da82b73-66b0-58d6-90df-91ac3c812b71","task_revision_id":"1","upstream_id":"","short_description":"A 22-year-old male college student presents to the office with a 6-month history…","config":"all","split":"test","body":"{\"choices\":\"['C1-C2', 'T1-T4', 'T7-L2', 'L3-L5']\",\"question\":\"A 22-year-old male college student presents to the office with a 6-month history of intermittent loose stools alternating with constipation. He says that he has been constipated for the past 5 days and denies hematochezia and melena. He says that he usually has loose stools during final exam week. Vital signs are normal. Physical examination reveals mild diffuse abdominal tenderness, and the remainder of the findings are normal. Where does the sympathetic innervation for the viscera involved in this patient's condition originate?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}