{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e537ffa8-5807-5474-98fd-2f023886e09e","task_key":"default--test--6076","task_revision_id":"1","upstream_id":"6076","short_description":"A certain molecule acts by binding to cytochrome oxidase A3, the final enzyme in…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Decrease the rate of glycolysis, leading to a drop in ATP production.', 'Have no effect as cells would switch which macronutrient they metabolize to circumvent the blocked biochemical pathway.', 'Stimulate the cell to increase its production of cytochrome oxidase A3 to compensate for the blocked enzyme.', 'Lead to the overproduction of NADH, causing a buildup of toxic metabolites in the cell.', 'Increase the cell’s ATP production as negative feedback would cause the cell to up-regulate anaerobic pathways.', 'Increase the efficiency of the electron transport chain by providing an alternative pathway for electron transfer.', 'Have no effect as the cells would increase their reliance on fatty acid oxidation for energy production.', 'Lead to death due to an inability of the cell to pass electrons to oxygen, thus stopping aerobic respiration and asphyxiating the cells.', 'Lead to death due to an inadequate supply of ADP to accept a phosphate group at the ATP synthase enzyme.', 'Cause a rapid increase in the production of reactive oxygen species, leading to oxidative stress and cell death.']\",\"question\":\"A certain molecule acts by binding to cytochrome oxidase A3, the final enzyme in the electron transport chain. Administration of a large dose of this substance to a human would likely:\",\"src\":\"ori_mmlu-college_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}