{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"61d35b42-6424-5bfd-bbaf-ddecefd90ec9","task_key":"default--test--10081","task_revision_id":"1","upstream_id":"10081","short_description":"An image is produced by an object 1 m in front of a con-cave mirror whose radius…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['42.75 cm closer to the mirror', '27.75 cm closer to the mirror', '85 cm away from the mirror', '30 cm away from the mirror', '15 cm closer to the mirror', '100 cm closer to the mirror', '72.25 cm away from the mirror', '72.25 cm closer to the mirror', '50 cm away from the mirror', '57.25 cm away from the mirror']\",\"question\":\"An image is produced by an object 1 m in front of a con-cave mirror whose radius of curvature is 30 cm. It is required to move the image 15 cm farther away from the mirror. How far and in which direction should the object be moved in order to accomplish this?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}