{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6c7c0fb1-6120-5aa9-9408-930272f1daa1","task_key":"default--test--3071","task_revision_id":"1","upstream_id":"3071","short_description":"What are the consequences of intenseinterspecific competition?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['increased species diversity', 'Homogenization of species traits', 'Decreased genetic diversity within species', 'Spontaneous generation of new species', 'Development of identical ecological niches', 'creation of new resources', 'extinction of rival species, evolution in divergent directions, and the principle of competitive exclusion', 'Unrestricted population growth for both species', 'Formation of stable mutualistic relationships', 'enhanced cooperation among species']\",\"question\":\"What are the consequences of intenseinterspecific competition?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}