{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"638bf93d-4587-52fe-a2df-2972b56ca37f","task_key":"all--test--638bf93d-4587-52fe-a2df-2972b56ca37f","task_revision_id":"1","upstream_id":"","short_description":"Why do Uranus and Neptune have blue methane clouds but Jupiter and Saturn do…","config":"all","split":"test","body":"{\"choices\":\"['Methane does not condense into ice in the warmer atmospheric temperatures of Jupiter and Saturn.', 'Methane did not exist in the solar nebula at the radii of Jupiter and Saturn when the planets formed.', 'The relatively slow rotation of Uranus and Neptune allows methane to migrate to higher levels in the atmosphere and condense into clouds.', 'Methane reacts with the abundant ammonia clouds in Jupiter and Saturn and is removed from the atmosphere.']\",\"question\":\"Why do Uranus and Neptune have blue methane clouds but Jupiter and Saturn do not?\",\"subject\":\"astronomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}