{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"007bc7c5-8c24-5eff-8e3d-78e3b9a389f8","task_key":"all--test--007bc7c5-8c24-5eff-8e3d-78e3b9a389f8","task_revision_id":"1","upstream_id":"","short_description":"Nitrous acid is a weak acid, while nitric acid is a much stronger acid because","config":"all","split":"test","body":"{\"choices\":\"['the nitrogen in nitric acid is more electronegative than the nitrogen in nitrous acid', 'nitric acid has more oxygen atoms in its formula', 'the –O–H bonds in nitric acid are much weaker than in nitrous acid due to the electron withdrawing of more oxygen atoms on nitric acid', 'nitric acid has the hydrogen atoms bound directly to the nitrogen atom']\",\"question\":\"Nitrous acid is a weak acid, while nitric acid is a much stronger acid because\",\"subject\":\"high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}