{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef07c1ca-50e3-5d39-aff1-67e428a54a66","task_key":"default--test--3254","task_revision_id":"1","upstream_id":"3254","short_description":"What trends in the evolution of the life cycle are evident from the algae to…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['There is a change from a dominating population that is mostly haploid to one that is almost entirely diploid, gradual reduction in the dependence of fertilization on the presence of moisture, and greater embryonic protection.', 'There is a gradual increase in the size and complexity of the gametophyte generation', 'Diploid phase becomes less dominant', 'There is increased dependence on moisture for fertilization', 'Flowering plants revert to a predominantly haploid stage with minimal embryonic development', 'There is a reduction in embryonic protection', 'The life cycle alternates between multicellular haploid and multicellular diploid phases without any clear dominance', 'Algae and flowering plants show no significant evolutionary changes in their life cycles', 'Flowering plants exhibit a decrease in the size and complexity of the sporophyte generation']\",\"question\":\"What trends in the evolution of the life cycle are evident from the algae to flowering plants?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}