{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2ab43de-1380-58af-bf04-fe49128c5911","task_key":"default--test--6634","task_revision_id":"1","upstream_id":"6634","short_description":"The function of the gastrointestinal tract can be classified in several ways.…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Elimination of toxins', 'Stimulation of appetite', 'Maintenance of barrier function', 'Extraction of maximum value from nutrients', 'Control of blood sugar levels', 'Production of hormones for growth and repair', 'Regulation of body temperature', 'Processing of food into a liquid form', 'Absorption and retention of water and electrolytes', 'Production of digestive enzymes']\",\"question\":\"The function of the gastrointestinal tract can be classified in several ways. Which of the following functions is most important for survival immediately after a meal?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}