{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4878e214-75b3-5eab-ae11-f4a4bf36f99f","task_key":"default--test--9048","task_revision_id":"1","upstream_id":"9048","short_description":"What is the source of the material that causes meteor showers?","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"[\\\"Large meteorites disintegrate in the Earth's atmosphere, creating smaller particles that cause a meteor shower.\\\", 'Near-Earth asteroids gradually disintegrate and spread out along their orbital paths. When the Earth passes through the orbit of an asteroid we are bombarded by sand-sized particles that cause a meteor shower.', 'Asteroid impacts elsewhere in the solar system throw sand-sized particles into space and occasionally the Earth passes through a cloud of these particles which burn up in our atmosphere and cause a meteor shower.', 'Meteor showers are caused by the Earth passing through a cloud of dust and debris left behind by the disintegration of planets in our solar system.', \\\"The gravitational pull of the moon causes rocks on its surface to be ejected into space. These rocks then enter Earth's atmosphere and cause a meteor shower.\\\", 'Meteor showers are caused by the Earth passing through the tail of a comet, where dust and ice particles are left behind.', 'Meteor showers are caused by the Earth passing through a cloud of dust and debris left behind by the disintegration of distant stars.', \\\"Near-Earth asteroids disintegrate as they enter Earth's atmosphere creating hundreds of bright meteors that appear to radiate from a single location in the sky.\\\", \\\"Meteor showers are caused by the disintegration of satellites and space debris as they re-enter the Earth's atmosphere.\\\", 'The nuclei of comets gradually disintegrate and spread out along their orbital paths. When the Earth passes through the orbit of an comet we are bombarded by sand-sized particles that cause a meteor shower.']\",\"question\":\"What is the source of the material that causes meteor showers?\",\"src\":\"ori_mmlu-astronomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}