{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4e8f50f2-73c3-5635-b09d-eba710111def","task_key":"default--test--9239","task_revision_id":"1","upstream_id":"9239","short_description":"AFabry-Perot interferometer is to be used to resolve the mode structure of a…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['0.424 cm and 4.24 mm', '3.35 cm and 0.318 mm', '0.335 cm and 3.18 mm', '3.18 cm and 0.335 mm', '1.59 cm and 1.59 mm', '3.18 cm and 3.35 mm', '2.12 cm and 2.12 mm', '6.70 cm and 0.636 mm', '4.24 cm and 0.424 mm', '1.06 cm and 1.06 mm']\",\"question\":\"AFabry-Perot interferometer is to be used to resolve the mode structure of a He-Ne laser operating at 6328 \\\\AA. The frequency separation between the modes is 150 MHZ. What plate spacing is required in (a) R = 0.9; (b) R = 0.999 (where R denotes the reflectance of the mirrors)?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}