{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"01feb020-11a9-5b21-bbb5-61fcb03c9369","task_key":"default--test--2945","task_revision_id":"1","upstream_id":"2945","short_description":"The skin is much more than merely an outer wrapping for an animal; it is an…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The skin primarily serves as a storage site for fat-soluble vitamins', \\\"The skin's primary function is to enhance physical appearance\\\", 'The primary function of the skin is to provide an outer covering for the body', 'The main function of the skin is to produce sweat and keep the body cool', \\\"The skin's main function is to regulate the level of oxygen entering the body\\\", 'The main function of the skin is to produce pigments that give color to the hair and eyes', \\\"The skin's primary function is to absorb nutrients from the external environment\\\", 'The primary role of the skin is to act as a secondary respiratory organ', 'The primary functions of the skin are to protect the body against external agents, maintain a constant internal environment, thermoregulation, and excretion of metabolic wastes.', 'The primary function of the skin is to facilitate the sense of touch only']\",\"question\":\"The skin is much more than merely an outer wrapping for an animal; it is an important organ system and performs many diverse functions. What are some of the primary functions of the skin in man?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}