{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b86ec5e-0ab2-5aca-afee-5485c8c21efa","task_key":"default--test--9361","task_revision_id":"1","upstream_id":"9361","short_description":"Which statement about an atom is not true:","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['A neutral atom always has equal numbers of electrons and protons.', 'The electrons can only orbit at particular energy levels.', 'Electrons and protons in a neutral atom are always equal in number.', 'Electrons can orbit at any energy level.', 'A neutral atom always has equal numbers of neutrons and protons.', 'The nucleus contains most of the atom’s mass but almost none of its volume.']\",\"question\":\"Which statement about an atom is not true:\",\"src\":\"ori_mmlu-astronomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}