{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6a272951-5a08-50af-af1e-137b0d580814","task_key":"default--test--3007","task_revision_id":"1","upstream_id":"3007","short_description":"The animals having radial symmetry are considered to be at a lower evolutionary…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Secondarily radial refers to the primary development of radial symmetry in an organism', 'Bilaterally symmetrical animals are considered more primitive due to their limited range of movement', 'Radial symmetry provides better mobility', 'Bilateral symmetry is a characteristic of invertebrates only', 'Radially symmetrical animals are considered at a lower evolutionary stage due to their simple body construction and lack of distinct internal organs or central nervous system. Secondarily radial refers to organisms like echinoderms that evolved from a bilaterally symmetrical ancestor and exhibit radial symmetry as adults but bilateral symmetry as larvae.', 'Secondarily radial refers to the secondary development of bilateral symmetry in an organism', 'Radial symmetry is associated with more advanced sensory organs', 'Bilaterally symmetrical animals have less distinct internal organs', 'Radially symmetrical animals have more complex reproductive systems']\",\"question\":\"The animals having radial symmetry are considered to be at a lower evolutionary stage than those having bilateral symmetry. Why is this true? What is meant by the term secondarily radial?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}