{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"311556b7-de59-5e70-92ed-3fd5a34fe9b4","task_key":"all--test--311556b7-de59-5e70-92ed-3fd5a34fe9b4","task_revision_id":"1","upstream_id":"","short_description":"Fluorine has a normal boiling point of 85 K, and chlorine boils at 239 K. The…","config":"all","split":"test","body":"{\"choices\":\"['Chlorine has a higher dipole moment than fluorine.', 'The intramolecular bonds in Cl2 are much weaker than those in F2.', 'The Cl2 electron clouds are much more polarizable than the F2 electron clouds, resulting in much stronger London forces.', 'The mass of chlorine is much greater than the mass of fluorine.']\",\"question\":\"Fluorine has a normal boiling point of 85 K, and chlorine boils at 239 K. The Cl2 molecule is much larger than F2 (atomic radius is 99 pm for chlorine and is 64 pm for fluorine). Which is the best reason for the large difference in boiling points?\",\"subject\":\"high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}