{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bdd541ba-4043-525d-8271-28cbca7f2915","task_key":"default--test--3029","task_revision_id":"1","upstream_id":"3029","short_description":"What do the words 'gymnosperm' and 'angiosperm' mean? What characteristics…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"[\\\"Gymnosperm means 'naked seeds' and angiosperm means 'enclosed seeds'. Conifers are distinguished from flowering plants by their ability to grow in colder climates and their distinct cone-like fruits.\\\", \\\"Gymnosperm means 'naked seeds' and angiosperm means 'enclosed seeds', but conifers are not distinguished from flowering plants as both include species with cones and flowers.\\\", 'Conifers are distinguished from flowering plants by their broad, flat leaves.', \\\"Both gymnosperms and angiosperms mean 'enclosed seeds'; however, conifers have leaves that change color and drop in the autumn, unlike flowering plants.\\\", \\\"Angiosperms mean 'naked seeds' and gymnosperms mean 'enclosed seeds'. Conifers are distinguished from flowering plants by their soft, fleshy cones and brightly colored flowers.\\\", \\\"Gymnosperm means 'enclosed seeds' and angiosperm means 'naked seeds'.\\\", 'Angiosperms produce cones while conifers produce flowers and fruits.', \\\"Gymnosperm means 'naked seeds' and angiosperm means 'enclosed seeds'. Conifers are distinguished from flowering plants by their needle-like leaves, xylem consisting almost entirely of tracheids, and their reproductive structures (cones).\\\", 'Gymnosperms are plants with flowers and fruits, while angiosperms are plants with cones and needle-like leaves.', \\\"Gymnosperm means 'enclosed seeds' and angiosperm means 'naked seeds'. Conifers are distinguished from flowering plants by their evergreen foliage and their production of fruits instead of cones.\\\"]\",\"question\":\"What do the words 'gymnosperm' and 'angiosperm' mean? What characteristics distinguish conifers from flowering plants?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}