{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c295907b-5bdf-5d20-bdc9-07db21141aa3","task_key":"default--test--3395","task_revision_id":"1","upstream_id":"3395","short_description":"Differentiate clearly between \"breathing\" and \"respiration\".","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Breathing is the chemical process that occurs within cells, while respiration is the physical movement of the diaphragm and rib muscles.', 'Respiration only occurs in the presence of oxygen, while breathing can occur without oxygen.', 'Breathing refers to the exchange of gases between cells and environment, while respiration is the mechanical process of taking air into the lungs and expelling it.', 'Respiration refers to the oxidative degradation of nutrients in cells or the exchange of gases between cells and environment, while breathing is the mechanical process of taking air into the lungs and expelling it.', 'Respiration and breathing are the same process.', 'Respiration is the process by which organisms produce sound, while breathing is solely for gas exchange purposes.', 'Breathing is the process of breaking down food into energy, while respiration is the act of air moving in and out of the lungs.', 'Respiration is an energy consuming process, while breathing results in energy production in the cells.', 'Breathing involves the conversion of glucose to energy within the mitochondria, while respiration is the act of inhaling and exhaling air.', 'Respiration is a voluntary action controlled by the nervous system, while breathing is an involuntary process controlled by the brain stem.']\",\"question\":\"Differentiate clearly between \\\"breathing\\\" and \\\"respiration\\\".\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}