{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ea02920a-99ed-5db3-989a-b3fc5fed6c3d","task_key":"default--test--9283","task_revision_id":"1","upstream_id":"9283","short_description":"Astronomers have found that many stellar objects contain hydrogen atoms that…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['0.021 cm', '0.0021 cm', '0.21 cm', '2.1 cm', '210 cm', '2100 cm', '21 cm', '1.42 cm', '142 cm', '42 cm']\",\"question\":\"Astronomers have found that many stellar objects contain hydrogen atoms that emit photons. Find the wavelength of this radiation and express the value in centimeters (the conventional unit used by astronomers to measure radio photon spectra) if the approximate value for the frequency of theemmittedphotons is 1.42 × 10^9 Hz.\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}