{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cbdc1922-e55d-5c7a-8037-b670089d3a3f","task_key":"all--test--cbdc1922-e55d-5c7a-8037-b670089d3a3f","task_revision_id":"1","upstream_id":"","short_description":"Bromine has a normal boiling point of 59 °C, and iodine boils at 184 °C. The I2…","config":"all","split":"test","body":"{\"choices\":\"['Bromine is a liquid and boils; iodine is a solid and sublimes.', 'The intramolecular bonds in I2 are much weaker than those in Br2.', 'The I2 electron clouds are much more polarizable than the Br2 electron clouds, resulting in much stronger London forces.', 'The mass of iodine is much greater than the mass of bromine.']\",\"question\":\"Bromine has a normal boiling point of 59 °C, and iodine boils at 184 °C. The I2 molecule is much larger than Br2 (atomic radii are 114 and 133 pm, respectively). Which is the best reason for the large difference in boiling points?\",\"subject\":\"high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}