{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b4f992c-e7ee-5746-b246-0b9f2b8effb7","task_key":"default--test--6630","task_revision_id":"1","upstream_id":"6630","short_description":"Which of the following statements about the diets and nutritional status of…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Older people generally have a lower energy intake than younger adults.', 'Older people tend to consume more protein than younger adults.', 'Older people have a higher energy intake than younger adults.', 'Multiple micronutrient deficiencies are rare in older people in high-income countries.', 'There is little variation in the dietary intake between older people.', 'Reports suggest that older people consume less than the recommended contribution of fat to energy intake.', 'Multiple micronutrient deficiencies are widespread in older people in high-income countries.', 'Older people generally consume more than the recommended contribution of fat to energy intake.']\",\"question\":\"Which of the following statements about the diets and nutritional status of older people is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}