{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d0d65245-82ba-5635-a492-7722e25fc094","task_key":"default--test--9767","task_revision_id":"1","upstream_id":"9767","short_description":"Which of the following statements about bosons and/or fermions is true?","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Fermions have antisymmetric wave functions and obey the Pauli exclusion principle.', 'Bosons have antisymmetric wave functions and do not obey the Pauli exclusion principle.', 'Bosons have antisymmetric wave functions and obey the Pauli exclusion principle.', 'Fermions have symmetric wave functions and do not obey the Pauli exclusion principle.', 'Fermions have symmetric wave functions and obey the Pauli exclusion principle.', 'Bosons have symmetric wave functions and do not obey the Pauli exclusion principle.', 'Both fermions and bosons have antisymmetric wave functions and do not obey the Pauli exclusion principle.', 'Fermions have antisymmetric wave functions and do not obey the Pauli exclusion principle.', 'Bosons have symmetric wave functions and obey the Pauli exclusion principle.', 'Fermions and bosons both have symmetric wave functions and obey the Pauli exclusion principle.']\",\"question\":\"Which of the following statements about bosons and/or fermions is true?\",\"src\":\"ori_mmlu-college_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}