{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d1cd99ef-cd24-5369-9acd-a668a18ad279","task_key":"default--test--3194","task_revision_id":"1","upstream_id":"3194","short_description":"Both food and air pass through the pharynx. Explain how these are channeled into…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Air is directed into the lungs by the bronchial sphincter, while food is funneled into the esophagus by the esophageal sphincter', 'When we swallow, the larynx moves up so that the glottis is closed by the epiglottis and the food or liquid passes into the esophagus behind the trachea. Breathing ceases momentarily during swallowing.', 'A flap called the tracheal flap opens and closes to direct food and air into the correct tubes', 'Food and air passages are controlled by a series of muscular valves that open and close in response to swallowing', 'The tongue pushes food into the esophagus, while a muscular reflex diverts air into the trachea', 'The nasal passage contracts to prevent food from entering the lungs while swallowing', 'The diaphragm adjusts its position to guide food and air into the esophagus or trachea, respectively', 'The larynx contracts to direct food and air into the appropriate tubes', 'Food and air are directed by the uvula into the appropriate tubes', 'Food and air are separated by cilia in the pharynx']\",\"question\":\"Both food and air pass through the pharynx. Explain how these are channeled into the proper tubes so that the food goes into the stomach and the air goes to the lungs.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}