{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a9ffd47-4d01-56ed-a88f-8210b7bca79e","task_key":"default--test--9505","task_revision_id":"1","upstream_id":"9505","short_description":"Estimate the minimum voltage needed to excite K radiation from an x-ray tube…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['65000 volts and 0.22 A', '72800 volts and 0.21 A', '75000 volts and 0.19 A', '76000 volts and 0.17 A', '69000 volts and 0.22 A', '73000 volts and 0.23 A', '71000 volts and 0.18 A', '74000 volts and 0.25 A', '68000 volts and 0.24 A', '70000 volts and 0.20 A']\",\"question\":\"Estimate the minimum voltage needed to excite K radiation from an x-ray tube with a tungsten target, and calculate the wavelength of the K_\\\\alpha line.\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}