{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"759e8c23-acb0-545d-9794-9bd6308eee72","task_key":"default--test--3456","task_revision_id":"1","upstream_id":"3456","short_description":"What factors limit the number oftrophiclevels in afood chain?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Constant energy levels across all trophic levels', 'Increase in nutrient availability at each level', 'Decrease in carbon dioxide concentration', 'Increase in biomass at each successive level', 'Great decrease (90%) in available energy at each level', 'Decrease in the number of predators', 'High reproductive rates at higher trophic levels', 'Increase in available energy at each level', 'Increase in the number of organisms', 'Uniform distribution of organisms across all levels']\",\"question\":\"What factors limit the number oftrophiclevels in afood chain?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}