{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7372849f-ba8d-5d6c-84ef-acd1d22860a7","task_key":"all--test--7372849f-ba8d-5d6c-84ef-acd1d22860a7","task_revision_id":"1","upstream_id":"","short_description":"A certain molecule acts by binding to cytochrome oxidase A3, the final enzyme in…","config":"all","split":"test","body":"{\"choices\":\"['Lead to death due to an inability of the cell to pass electrons to oxygen, thus stopping aerobic respiration and asphyxiating the cells.', 'Lead to death due to an inadequate supply of ADP to accept a phosphate group at the ATP synthase enzyme.', 'Have no effect as cells would switch which macronutrient they metabolize to circumvent the blocked biochemical pathway.', 'Increase the cell’s ATP production as negative feedback would cause the cell to up-regulate anaerobic pathways.']\",\"question\":\"A certain molecule acts by binding to cytochrome oxidase A3, the final enzyme in the electron transport chain. Administration of a large dose of this substance to a human would likely:\",\"subject\":\"college_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}