{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"13304886-9f3f-57d0-bc14-d27157af87c2","task_key":"default--test--3366","task_revision_id":"1","upstream_id":"3366","short_description":"What is meant by a hydrostatic skeleton? In which organisms is such a structure…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['A hydrostatic skeleton is the rigid internal structure found in birds and mammals.', 'A hydrostatic skeleton refers to the muscular system in humans and other primates.', 'A hydrostatic skeleton is composed of gas-filled chambers that provide buoyancy in fish.', 'A hydrostatic skeleton is a hard shell covering the body', 'A hydrostatic skeleton is the body cavity filled with air that is found in spiders and insects.', 'A hydrostatic skeleton is a network of bones that provide support in amphibians and reptiles.', 'A hydrostatic skeleton is the noncompressible fluid contents of the body cavity in organisms like Cnidarians, flatworms, and annelids.', 'A hydrostatic skeleton is the flexible cartilage found in sharks and rays.', 'A hydrostatic skeleton is only found in vertebrates', 'A hydrostatic skeleton is the external structure of insects']\",\"question\":\"What is meant by a hydrostatic skeleton? In which organisms is such a structure found?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}