{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"05de3583-c115-5519-830e-be46256ffeb4","task_key":"all--test--05de3583-c115-5519-830e-be46256ffeb4","task_revision_id":"1","upstream_id":"","short_description":"The first ionization energy for a neutral atom of chlorine is 1.25 MJ/mol and…","config":"all","split":"test","body":"{\"choices\":\"['It would be greater than both because potassium carries a greater nuclear charge then either chlorine or argon.', 'It would be greater than both because the size of a potassium atom is smaller than an atom of either chlorine or argon.', 'It would be less than both because there are more electrons in potassium, meaning they repel each other more effectively and less energy is needed to remove one.', 'It would be less than both because a valence electron of potassium is farther from the nucleus than one of either chlorine or argon.']\",\"question\":\"The first ionization energy for a neutral atom of chlorine is 1.25 MJ/mol and the first ionization energy for a neutral atom of argon is 1.52 MJ/mol. How would the first ionization energy value for a neutral atom of potassum compare to those values?\",\"subject\":\"high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}