{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b1b7645-5b0d-5b7f-a894-81da20e1ff27","task_key":"default--test--3301","task_revision_id":"1","upstream_id":"3301","short_description":"Discuss the current theory of the evolution ofautotrophs…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Autotrophs and heterotrophs evolved simultaneously', 'The evolution of autotrophs was triggered by a single, catastrophic environmental event', 'Autotrophs evolved from heterotrophs through the acquisition of symbiotic bacteria', 'Heterotrophs evolved directly into autotrophs without any genetic mutations', 'Autotrophs arose as a separate lineage from heterotrophs with no evolutionary connection', 'The evolution of autotrophs was guided by human intervention', 'Evolution of autotrophs was a random process', 'Autotrophs evolved from heterotrophs due to environmental changes', 'Autotrophs evolved from heterotrophs due to the overabundance of organic nutrients', 'Successive gene mutations in certain heterotrophs led to the evolution of autotrophs']\",\"question\":\"Discuss the current theory of the evolution ofautotrophs fromprimitiveheterotrophs.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}