{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"93aea36e-d5cd-55cf-93d7-47e0e8e5a603","task_key":"default--test--10351","task_revision_id":"1","upstream_id":"10351","short_description":"Newton's rings are seen in transmitted light of 500 nm. The diameter of the 20th…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Radius of curvature of the lens is 50 cm and diameter of the 30th bright ring is 6.0 mm', 'Radius of curvature of the lens is 35 cm and diameter of the 30th bright ring is 4.9 mm', 'Radius of curvature of the lens is 39 cm and diameter of the 30th bright ring is 5.5 mm', 'Radius of curvature of the lens is 48 cm and diameter of the 30th bright ring is 5.1 mm', 'Radius of curvature of the lens is 35 cm and diameter of the 30th bright ring is 6.2 mm', 'Radius of curvature of the lens is 45 cm and diameter of the 30th bright ring is 6.5 mm', 'Radius of curvature of the lens is 39 cm and diameter of the 30th bright ring is 4.9 mm', 'Radius of curvature of the lens is 45 cm and diameter of the 30th bright ring is 5.2 mm', 'Radius of curvature of the lens is 30 cm and diameter of the 30th bright ring is 5.8 mm', 'Radius of curvature of the lens is 42 cm and diameter of the 30th bright ring is 5.0 mm']\",\"question\":\"Newton's rings are seen in transmitted light of 500 nm. The diameter of the 20th bright ring is found to be 4 mm. a) What is the radius of curvature of the lens? b) What is the diameter of the 30th bright ring?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}