{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b6b0e6de-c8cd-51a5-b82c-f443b979958d","task_key":"default--test--6457","task_revision_id":"1","upstream_id":"6457","short_description":"Which of the following statements about the nutritional status of older people…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Consuming multivitamins can eliminate all nutritional deficiencies in older people.', 'High protein diet is harmful for older people.', 'Older people are more prone to Vitamin A overdose.', 'All older people require dietary supplementation to maintain nutritional status.', 'The risk of high iron stores is greater than the risk of iron deficiency in older people.', 'Older people should consume more sodium to maintain their health.', 'All older people living in Western countries have low vitamin D status.', 'Low dietary intake of vitamin B12 is the main cause of vitamin B12 deficiency in older people.', 'Calcium intake is not important for older people.', 'There is strong evidence that vitamin C supplements lower the risk of cancer in older people.']\",\"question\":\"Which of the following statements about the nutritional status of older people is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}