{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ce53263-1ae6-5e3c-847f-337650d4aa2e","task_key":"default--test--10193","task_revision_id":"1","upstream_id":"10193","short_description":"Suppose an individual wants to view his face as reflected from an ordinary hand…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Radius of curvature: 160 cm, Focal length: 80 cm, Magnification: 2.5', 'Radius of curvature: 80 cm, Focal length: 20 cm, Magnification: 2', 'Radius of curvature: 100 cm, Focal length: 50 cm, Magnification: 1.5', 'Radius of curvature: 80 cm, Focal length: 40 cm, Magnification: 3', 'Radius of curvature: 40 cm, Focal length: 20 cm, Magnification: -1', 'Radius of curvature: 60 cm, Focal length: 40 cm, Magnification: 2', 'Radius of curvature: 30 cm, Focal length: 15 cm, Magnification: 3', 'Radius of curvature: 80 cm, Focal length: 40 cm, Magnification: 2', 'Radius of curvature: 60 cm, Focal length: 30 cm, Magnification: -2', 'Radius of curvature: 120 cm, Focal length: 60 cm, Magnification: 0.5']\",\"question\":\"Suppose an individual wants to view his face as reflected from an ordinary hand magnifying (concave) mirror. Let the mirror be 20 cm from the individual's face. He wishes to have an image 40 cm from the mirror. What should be the radius of curvature and the focal length of the mir-ror? What is the magnification of the image?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}