{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"17a40231-14a9-5166-acca-a419ccb491ee","task_key":"default--test--2861","task_revision_id":"1","upstream_id":"2861","short_description":"Many different fermentation pathways occur in different organisms in nature. For…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['It occurs in the cytoplasm.', 'It produces pyruvate, which is the raw material for oxidative phosphorylation.', 'It produces large amounts of ATP by oxidative phosphorylation.', 'It is the only way cells can produce ATP.', 'It produces lactic acid, which is essential for muscle function.', 'It reoxidizes NADH so that glycolysis can continue.', 'It produces large amounts of ATP by substrate level phosphorylation.', 'It requires oxygen to produce pyruvate.', 'It converts glucose into ATP.', 'It produces glucose, which is used in the Krebs cycle.']\",\"question\":\"Many different fermentation pathways occur in different organisms in nature. For example, skeletal muscle cells convert pyruvate into lactic acid when no oxygen is present. Yeast cells can produce alcohol and carbon dioxide under the same circumstances. However, regardless of the specific reactions, the purpose of glycolysis is an important one. Which statement best describes the importance of glycolysis?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}