{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b6ce7e68-5d99-5ad8-8564-686d1b5fbe90","task_key":"default--test--3365","task_revision_id":"1","upstream_id":"3365","short_description":"What basic nutritional requirements do all livingorganisms have in common?…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Only animals and plants have basic nutritional requirements.', 'All organisms can derive their nutritional needs from consuming other organisms and do not require any specific elements or compounds for growth.', 'All organisms require only sunlight and carbon dioxide for growth.', 'All organisms require a source of energy and vitamins, but do not need a carbon source or water for growth.', 'Organisms require a source of energy, a carbon source, and water, but do not need nitrogen or vitamins for growth.', 'Organisms require only water and energy for growth.', 'Carbon and nitrogen are the only necessary nutrients for organisms.', 'Only autotrophs require a carbon source and a nitrogen source, while heterotrophs can survive on energy alone.', 'All organisms require a source of energy, a carbon source, a nitrogen source, sulfur and phosphorous, certain metallic elements, vitamins, and water for growth.', 'Only phototrophs have basic nutritional requirements, while chemotrophs do not require any nutrients.']\",\"question\":\"What basic nutritional requirements do all livingorganisms have in common? Comparephototrophsandchemotrophs, autotrophs andheterotrophs.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}