{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ecc4b40-21a0-54a6-ab9f-fae13967c098","task_key":"default--test--10349","task_revision_id":"1","upstream_id":"10349","short_description":"A Michelson interferometer is used for measuring the separation of a doublet of…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['675.74 nm and 676.26 nm', '676.1 nm and 675.9 nm', '672 nm and 680 nm', '675 nm and 677 nm', '674 nm and 678 nm', '670 nm and 680 nm', '674.5 nm and 677.5 nm', '673 nm and 679 nm', '676.5 nm and 675.5 nm', '677 nm and 675 nm']\",\"question\":\"A Michelson interferometer is used for measuring the separation of a doublet of atomic emission lines. The average wavelength of the doublet is known to be 676 nm. Periodic variations of the fringe contrast are found whenever one of the mirrors is moved through a distance of 0.44 mm. What are the two wavelengths of the doublet?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}