{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"068653bd-0488-5a7a-8256-d4f1db31aa86","task_key":"default--test--9813","task_revision_id":"1","upstream_id":"9813","short_description":"If the force of gravity between the Moon and the Earth were to stop, which…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['It would continue rotating on its axis, but it would start revolving around the Sun.', 'It would continue rotating on its axis, and it would start revolving around Mars.', 'It would stop rotating on its axis, and it would stop revolving around the Earth.', 'It would stop rotating on its axis, but it would revolve around the Earth as usual.', 'It would continue rotating on its axis, but it would stop revolving around the Earth.', 'It would stop rotating on its axis, and it would start revolving around the Sun.', 'It would continue rotating on its axis, and it would revolve around the Earth as usual.', 'It would start rotating slower on its axis, but it would revolve around the Earth as usual.', 'It would stop rotating on its axis, and it would start revolving around Jupiter.', 'It would start rotating faster on its axis, and it would stop revolving around the Earth.']\",\"question\":\"If the force of gravity between the Moon and the Earth were to stop, which statement best describes the resulting motion of the moon?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}