{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"230d8696-9ca3-5497-aeee-2dfd8e7b92ff","task_key":"default--test--10097","task_revision_id":"1","upstream_id":"10097","short_description":"How do scientists know that the majority of meteorites come from the asteroid…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The spectra of some meteorites are similar to the spectra of asteroids in the asteroid belt.', 'The chemical composition of meteorites is identical to the composition of asteroids from the asteroid belt.', 'The size and shape of meteorites match the size and shape of asteroids in the asteroid belt.', 'The trajectory of meteorites points back to the asteroid belt.', 'The asteroid belt is the only possible source of meteorites therefore they must originate there.', 'The density of meteorites is the same as the density of asteroids in the asteroid belt.', 'Collisions are common in the asteroid belt and we can track the fragments from their source asteroid to the Earth where they become meteorites.', 'Scientists have found inscriptions on meteorites that indicate they originated from the asteroid belt.', 'Scientists have observed meteorites being ejected from the asteroid belt.']\",\"question\":\"How do scientists know that the majority of meteorites come from the asteroid belt?\",\"src\":\"ori_mmlu-astronomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}