{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ac25801-8cb4-5daf-97ac-2a923f5ba5ab","task_key":"default--test--2915","task_revision_id":"1","upstream_id":"2915","short_description":"Why does one experience difficulty in breathing at high altitudes ?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['At high altitudes, the amount of hemoglobin in blood decreases', \\\"At high altitudes, the body's respiratory rate decreases, leading to reduced oxygen intake\\\", 'At high altitudes, the air is less polluted, leading to difficulty in adapting to the cleaner environment', 'At high altitudes, the air becomes thicker, making it harder to breathe', 'At high altitudes, the temperature of the air increases, reducing its oxygen content', 'At high altitudes, the barometric pressure and the partial pressure of oxygen decrease, leading to less saturation of hemoglobin with oxygen, causing hypoxia, or deficiency of oxygen at the tissue level.', 'At high altitudes, the percentage of nitrogen in air increases', \\\"At high altitudes, the ultraviolet radiation from the sun increases, which affects the body's ability to utilize oxygen\\\", 'At high altitudes, the overall air pressure increases, which hinders oxygen absorption', 'At high altitudes, the percentage of carbon dioxide in air increases']\",\"question\":\"Why does one experience difficulty in breathing at high altitudes ?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}