{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51bf7dac-9e9e-578a-8d51-7d6bd7a461ea","task_key":"all--test--51bf7dac-9e9e-578a-8d51-7d6bd7a461ea","task_revision_id":"1","upstream_id":"","short_description":"If the force of gravity between the Moon and the Earth were to stop, which…","config":"all","split":"test","body":"{\"choices\":\"['It would continue rotating on its axis, and it would revolve around the Earth as usual.', 'It would continue rotating on its axis, but it would stop revolving around the Earth.', 'It would stop rotating on its axis, but it would revolve around the Earth as usual.', 'It would stop rotating on its axis, and it would stop revolving around the Earth.']\",\"question\":\"If the force of gravity between the Moon and the Earth were to stop, which statement best describes the resulting motion of the moon?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}