{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dcb43141-cd4b-5fb3-a4cd-5fbbedcb39ed","task_key":"default--test--3230","task_revision_id":"1","upstream_id":"3230","short_description":"What advantages domulticellularorganisms haveover single-celledorganisms?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Multicellular organisms have a shorter lifespan, which allows for quicker evolutionary adaptations.', 'Multicellular organisms are always larger than single-celled organisms, providing them with better defense mechanisms.', 'Multicellular organisms are less versatile than single-celled organisms.', 'Multicellular organisms have specialized cells for a variety of functions, higher order of complexity, better adaptation to different environments including land, and potential for diversity.', 'Multicellular organisms can reproduce faster than single-celled organisms.', 'Multicellular organisms can move more rapidly and with greater coordination than single-celled organisms.', 'Multicellular organisms can synthesize everything they need from a few simple nutrients.', 'Multicellular organisms have a smaller surface area to volume ratio, which is advantageous for cellular processes.', 'Multicellular organisms do not need to consume food as they produce their own energy through photosynthesis.', 'Multicellular organisms can survive only in a watery environment.']\",\"question\":\"What advantages domulticellularorganisms haveover single-celledorganisms?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}