{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0acafae-2828-598e-91c6-f557c29b2b5a","task_key":"default--test--2841","task_revision_id":"1","upstream_id":"2841","short_description":"Besides their function in locomotion and support, bones also serve several other…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Bones help in digestion', 'Bones regulate body temperature by acting as thermal insulators.', 'Bones are involved in the filtration and excretion of waste products.', 'Bones aid in vision', 'Bones are responsible for the synthesis of vitamin C.', \\\"Bones contain the majority of the body's muscle attachment sites for movement.\\\", 'Bones are used for blood storage', 'Bones are important for mineral storage, particularly calcium and phosphorus, and are the site of production for lymphocyte precursor cells and red blood cells.', 'Bones provide protection for all internal organs.', 'Bones produce hormones that control blood sugar levels.']\",\"question\":\"Besides their function in locomotion and support, bones also serve several other important functions. What are they?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}