{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b660d5d5-d1e5-5cc8-8520-62745ce44052","task_key":"default--test--3253","task_revision_id":"1","upstream_id":"3253","short_description":"What evidence supports the theory that vascular plants evolved directly from…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Fossil records indicate a sudden appearance of vascular plants without any bryophyte intermediates', 'Vascular plants and bryophytes evolved independently', 'Vascular plants evolved from bryophytes', 'There is no evidence supporting the theory', 'Structural similarities in reproductive organs between vascular plants and certain green algae', 'The presence of similar photosynthetic pigments in vascular plants and green algae', 'Vascular plants share a more recent common ancestor with charophyte algae than with bryophytes', 'Genetic markers unique to vascular plants are also found in certain species of bryophytes', 'Ancient green algae were the common ancestors of both higher nonvascular and vascular plants', 'Bryophytes lack the specialized vascular tissue found in green algae']\",\"question\":\"What evidence supports the theory that vascular plants evolved directly from green algae, and not from bryophytes?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}