{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92967250-e9ff-5827-935b-d73e3efb64e5","task_key":"default--test--9680","task_revision_id":"1","upstream_id":"9680","short_description":"Why are there no impact craters on the surface of Io?","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"[\\\"Any craters that existed have been eroded through the strong winds on Io's surface.\\\", 'Io is protected by a layer of gas that prevents any objects from reaching its surface.', 'The gravitational pull of nearby moons prevent objects from hitting Io.', \\\"Io's magnetic field deflects incoming asteroids, preventing impact craters.\\\", 'Io did have impact craters but they have all been buried in lava flows.', 'The surface of Io is made of a material that does not leave a visible impact crater.', \\\"Jupiter's strong gravity attracted the planetesimals more strongly than Io and thus none landed on its surface.\\\", 'It is too small to have been hit during the Late Heavy Bombardment', \\\"Io's thick atmosphere burns up any objects before they can hit the surface.\\\"]\",\"question\":\"Why are there no impact craters on the surface of Io?\",\"src\":\"ori_mmlu-astronomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}