{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"207df584-8fb9-5fee-a2dc-bad1260ed9bc","task_key":"default--test--3427","task_revision_id":"1","upstream_id":"3427","short_description":"Euglena is a common green flagellate protozoan found in fresh water ponds.…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Euglena moves by contracting its body, carries on heterotrophic nutrition, and reproduces asexually through fragmentation.', 'Euglena moves by flagellum, carries on autotrophic nutrition and can switch to heterotrophic when necessary, and reproduces asexually through cytokinesis.', 'Euglena moves by pseudopodia, carries on heterotrophic nutrition, and reproduces sexually.', 'Euglena moves by flagellum, carries on autotrophic nutrition but cannot shift to heterotrophic, and reproduces asexually through budding.', 'Euglena moves by flagellum, carries on chemosynthetic nutrition, and reproduces asexually through sporulation.', 'Euglena moves by undulating its flagellum, carries on autotrophic nutrition but can shift to heterotrophic under darkness, and reproduces asexually through longitudinal binary fission.', 'Euglena moves by jet propulsion, carries on autotrophic nutrition, and reproduces asexually through multiple fission.', 'Euglena moves by cilia, carries on autotrophic nutrition but can shift to heterotrophic under light, and reproduces asexually through binary fission.', 'Euglena moves by gliding along surfaces, carries on autotrophic nutrition but can shift to heterotrophic in the absence of light, and reproduces asexually through budding.', 'Euglena moves by flagellum, carries on mixotrophic nutrition, and reproduces asexually through longitudinal binary fission and sporulation.']\",\"question\":\"Euglena is a common green flagellate protozoan found in fresh water ponds. Describe briefly the method of locomotion, nutrition, and asexual reproduction in this organism.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}