{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4119d4fe-3d2f-570b-b5b5-806407dead15","task_key":"default--test--3743","task_revision_id":"1","upstream_id":"3743","short_description":"The atomic radius of hydrogen is 0.037 nm, Compare this figure with the length…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['The atomic radius of hydrogen is five times the first Bohr radius', 'The atomic radius of hydrogen is four times the first Bohr radius', 'The atomic radius of hydrogen is half the first Bohr radius', 'The atomic radius of hydrogen is one tenth the first Bohr radius', 'The atomic radius of hydrogen is larger than the first Bohr radius', 'The atomic radius of hydrogen is unrelated to the first Bohr radius', 'The atomic radius of hydrogen is smaller than the first Bohr radius', 'The atomic radius of hydrogen is three times the first Bohr radius', 'The atomic radius of hydrogen is twice the first Bohr radius', 'The atomic radius of hydrogen is equal to the first Bohr radius']\",\"question\":\"The atomic radius of hydrogen is 0.037 nm, Compare this figure with the length of the first Bohr radius. Explain any differences.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}