{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7ba8678-240c-55ad-80ee-ffaca019751d","task_key":"default--test--3066","task_revision_id":"1","upstream_id":"3066","short_description":"What function does oxygen serve in the body?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Oxygen is used to maintain the temperature of cells.', 'Oxygen is used by cells to produce alcohol.', 'Oxygen is used to produce carbon dioxide in cells.', 'Oxygen is solely responsible for stimulating brain activity.', 'Oxygen is used to synthesize proteins in cells.', 'Oxygen converts glucose directly into energy without any metabolic processes.', 'Oxygen is necessary for the process of cellular respiration.', 'Oxygen is used for photosynthesis in cells.', 'Oxygen helps to break down nutrients in the digestive system.', 'Oxygen acts as a lubricant for joints and muscles.']\",\"question\":\"What function does oxygen serve in the body?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}