{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"300447eb-c5c2-5d5e-beb8-87800053f432","task_key":"default--test--3316","task_revision_id":"1","upstream_id":"3316","short_description":"Sea divers are aware of a danger known as the \"bends\". Explain the physiological…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Carbon dioxide bubbles forming in the blood causing acidosis', 'Rapid increase in barometric pressure causing the bends', 'Formation of helium bubbles in the bloodstream due to rapid ascent', 'Increased salinity in the water leading to dehydration and joint pain', 'Oxygen bubbles forming in the blood leading to hypoxia', 'Lack of oxygen while breathing under high pressure leading to the bends', 'Accumulation of lactic acid in muscles due to strenuous activity underwater', 'Sudden decrease in water temperature causing muscle cramping and disorientation', 'Rise in blood pressure due to underwater currents, resulting in the bends', 'Bubbles of nitrogen gas form in the blood and other tissue fluids when the barometric pressure drops below the total pressure of all gases dissolved in the body fluids, causing dizziness, paralysis, and unconsciousness, known as the bends.']\",\"question\":\"Sea divers are aware of a danger known as the \\\"bends\\\". Explain the physiological mechanism of the bends.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}