{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b14c74df-d4d4-5870-b843-f28e458dd879","task_key":"default--test--9169","task_revision_id":"1","upstream_id":"9169","short_description":"Electromagnetic radiation provides a means to probe aspects of the physical…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['All spectra are essentially the same for all elements.', 'The wavelengths identified in an absorption spectrum of an element are among those in its emission spectrum.', 'Spectral analysis can be used to identify the composition of galactic dust.', 'Spectral lines in the radio frequency region reveal the rotational structure of molecules.', 'Absorption and emission spectra of an element are always identical.', 'Lines in the infrared, visible, and ultraviolet regions of the spectrum reveal primarily the nuclear structure of the sample.', 'Emission spectra can be used to determine the temperature of a star.', 'X-ray spectroscopy is used primarily to identify the presence of biological molecules.', \\\"Spectral analysis can't determine the relative abundance of elements in a sample.\\\", 'Absorption spectra can be used to determine which elements are present in distant stars.']\",\"question\":\"Electromagnetic radiation provides a means to probe aspects of the physical universe. Which of the following statements regarding radiation spectra is NOT correct?\",\"src\":\"ori_mmlu-college_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}