{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ce4d9e7b-fa6a-55a1-8b03-d6d33758ecd8","task_key":"default--test--10347","task_revision_id":"1","upstream_id":"10347","short_description":"An object is placed 1 foot from a concave mirror of radius 4 feet. If the object…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['4 inches closer to the mirror', '6 inches closer to the mirror', 'Moves away from the mirror by 2 inches', '3.7in closer to the mirror', '5 inches closer to the mirror', 'Moves away from the mirror by 3.7 inches', '1 inch closer to the mirror', 'No displacement of the image', '1.2 inches closer to the mirror', '2.5 inches closer to the mirror']\",\"question\":\"An object is placed 1 foot from a concave mirror of radius 4 feet. If the object is moved 1 inch nearer to the mirror, what will be the corresponding displacement of the image?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}