{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"44115541-160f-54e6-bcaf-2f16ab9916eb","task_key":"all--test--44115541-160f-54e6-bcaf-2f16ab9916eb","task_revision_id":"1","upstream_id":"","short_description":"Why do jovian planets bulge around the equator that is have a \"squashed\"…","config":"all","split":"test","body":"{\"choices\":\"['Their large systems of moons and rings gravitationally attract the mass around the equator more.', 'They are much more massive than the terrestrial planets.', 'Their rapid rotation flings the mass near the equator outward.', 'Their internal heat sources exert a pressure against the sides of the planets.']\",\"question\":\"Why do jovian planets bulge around the equator that is have a \\\"squashed\\\" appearance?\",\"subject\":\"astronomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}