{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"67e8f7c0-2043-58b7-aef5-45536ce5e667","task_key":"default--test--9316","task_revision_id":"1","upstream_id":"9316","short_description":"When a uranium nucleus undergoes fission the energy released is primarily in the…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['energy of alpha particles.', 'energy of electromagnetic waves.', 'gamma radiation.', 'All of these about equally.', 'potential energy.', 'thermal energy.', 'kinetic energy of fission fragments.', 'energy of created protons.', 'energy of beta particles.', 'kinetic energy of ejected neutrons.']\",\"question\":\"When a uranium nucleus undergoes fission the energy released is primarily in the form of\",\"src\":\"ori_mmlu-conceptual_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}