{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da68adf3-2e97-5247-ba61-ea126a7c91b0","task_key":"default--test--2854","task_revision_id":"1","upstream_id":"2854","short_description":"How does energy release in combustion differ fromenergy releasein aerobic…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Combustion releases energy rapidly as heat which would destroy a cell. In contrast, aerobic respiration releases energy sequentially in small packets, transforming and storing it in the form of ATP, preventing damage to the cell.', 'Both release energy rapidly', 'Combustion releases energy in small packets', 'Combustion is a type of aerobic respiration that occurs in specialized cell organelles', 'Aerobic respiration requires oxygen to release energy, while combustion does not require oxygen', 'Aerobic respiration releases all energy as heat', 'Combustion can occur in both living cells and non-living matter, while aerobic respiration only occurs in living cells', 'Combustion releases energy without producing any by-products, while aerobic respiration produces carbon dioxide and water as by-products', 'Aerobic respiration releases energy in the form of light, whereas combustion does not produce light', 'Aerobic respiration releases energy only in the presence of enzymes, while combustion does not involve enzymes']\",\"question\":\"How does energy release in combustion differ fromenergy releasein aerobic respiration?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}