{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6500dd33-dc5b-5132-a2b8-524b2504477a","task_key":"default--test--10354","task_revision_id":"1","upstream_id":"10354","short_description":"A carbon filament, which may be considered a blackbody radiator, is heated…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['500C: 4.25μm, 1000C: 3.25μm, 1500C: 2.75μm, 2500C: 1.75μm', '500C: 6.25μm, 1000C: 5.78μm, 1500C: 4.13μm, 2500C: 2.85μm', '500C: 3.75μm, 1000C: 2.28μm, 1500C: 2.63μm, 2500C: 2.05μm', '500C: 7.00μm, 1000C: 6.00μm, 1500C: 4.50μm, 2500C: 3.00μm', '500C: 2.95μm, 1000C: 2.50μm, 1500C: 2.00μm, 2500C: 1.50μm', '500C: 2.75μm, 1000C: 3.28μm, 1500C: 2.63μm, 2500C: 2.05μm', '500C: 4.50μm, 1000C: 3.50μm, 1500C: 2.95μm, 2500C: 1.95μm', '500C: 3.75μm, 1000C: 2.28μm, 1500C: 1.63μm, 2500C: 1.05μm', '500C: 5.75μm, 1000C: 4.28μm, 1500C: 3.63μm, 2500C: 3.05μm', '500C: 4.75μm, 1000C: 3.78μm, 1500C: 2.63μm, 2500C: 2.05μm']\",\"question\":\"A carbon filament, which may be considered a blackbody radiator, is heated successively to 500°C, 1000°C, 1500°C, and 2500°C. Find the corresponding wavelengths at which the most energy is emitted at these temperatures.\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}