{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3baeda6f-229c-5526-b02f-1df61fc4e46c","task_key":"default--test--10098","task_revision_id":"1","upstream_id":"10098","short_description":"Which of the following is not one of nor follows directly from Kepler's laws?","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The orbit of each planet about the Sun is an ellipse with the Sun at one focus.', 'A planet travels faster when it is nearer to the Sun and slower when it is farther from the Sun.', 'The time it takes for a planet to orbit the Sun is proportional to the cube of its average distance from the Sun.', 'As a planet moves around its orbit it sweeps out equal areas in equal times.', 'The force of attraction between any two objects decreases with the square of the distance between their centers.', 'The square of the orbital period of a planet is proportional to the cube of the semi-major axis of its orbit.']\",\"question\":\"Which of the following is not one of nor follows directly from Kepler's laws?\",\"src\":\"ori_mmlu-astronomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}