{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab093443-7206-596b-a81c-9e5a7e8ac3e8","task_key":"default--test--3277","task_revision_id":"1","upstream_id":"3277","short_description":"Describe the sequence of succession leading to a climax communityfrom a bare…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The sequence starts with ferns, followed by lichens, then grasses and finally shrubs and trees.', 'The sequence begins with aquatic plants, followed by mosses, then lichens, and finally terrestrial trees and shrubs.', 'The sequence of succession leading to a climax community from a bare rock surface begins with lichens, then mosses, followed by ferns or seeds of grasses and annual herbs, then perennial herbs, then shrubs and trees. This process is known as primary succession.', 'The sequence begins with annual herbs, followed by perennial herbs, then mosses and lichens.', 'The sequence starts with lichens, followed directly by trees, without intermediate stages of mosses, herbs, or shrubs.', 'The sequence starts with mosses, followed by lichens, then annual herbs, and concludes with the growth of perennial herbs only.', 'The sequence begins with grasses, followed by annual herbs, then shrubs, and finally trees without the presence of lichens or mosses.', 'Succession starts with shrubs and trees, then progresses backward to mosses, lichens, and ends with annual herbs.', 'The sequence initiates with perennial herbs, then moves to shrubs, followed by trees, and ends with mosses and lichens.', 'The sequence starts with trees, followed by shrubs and then mosses.']\",\"question\":\"Describe the sequence of succession leading to a climax communityfrom a bare rock surface.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}