{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7cc717e0-7752-5be0-b8ae-8905d6a6b726","task_key":"default--test--9858","task_revision_id":"1","upstream_id":"9858","short_description":"One of the tubes of a Rayleighrefractometeris filled with air, the other is…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['1.00099', '1.00069', '1.00039', '1.00049', '1.00000', '1.00029', '1.00009', '1.00019', '1.00059', '1.00079']\",\"question\":\"One of the tubes of a Rayleighrefractometeris filled with air, the other is evacuated. Then the second tube is filled with air at the same temperature and pressure as the first tube. During this process 98 fringes are seen to pass the field of view. What is the index of refraction of the air if sodium light is used and the tubes are each 20 cm long?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}