{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"47dee08c-fc6d-5b25-9cf1-a5b58956334b","task_key":"default--test--9582","task_revision_id":"1","upstream_id":"9582","short_description":"Find the phase difference between light reflected from the inner and outer…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['210 degrees and 110 degrees', '248 degrees and 142 degrees', '300 degrees and 150 degrees', '230 degrees and 130 degrees', '256 degrees and 144 degrees', '200 degrees and 120 degrees', '270 degrees and 135 degrees', '315 degrees and 175 degrees', '180 degrees and 90 degrees', '290 degrees and 160 degrees']\",\"question\":\"Find the phase difference between light reflected from the inner and outer surfaces of a deposit of magnesium fluoride (n = 1.38) 1000 \\\\AA thick on a lens surface (a) for violet light of wavelength 4000 \\\\AA (b) for red light of wavelength 7000 \\\\AA. (Neglect variations of n with \\\\lambda.)\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}