{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"11ad529c-411f-5f73-bf0d-5001dea463ab","task_key":"all--test--11ad529c-411f-5f73-bf0d-5001dea463ab","task_revision_id":"1","upstream_id":"","short_description":"Amnesic Disorders describe conditions where there is memory impairment with no…","config":"all","split":"test","body":"{\"choices\":\"['These disorders cause a loss of recall of learned information = anterograde amnesia.', 'Someone with condition confabulates to fill in gaps in the memory.', 'These disorders can be caused by any pathological process that affects brain areas associated with memory.', 'Amnesic disorders can be associated with hypnotics and sedatives']\",\"question\":\"Amnesic Disorders describe conditions where there is memory impairment with no other significant cognitive impairments. Which of the following statements is incorrect in relation to Amnesic Disorders?\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}