{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a4ce6d1-5b5c-52cb-90b9-a2e31aa8b8ab","task_key":"default--test--6320","task_revision_id":"1","upstream_id":"6320","short_description":"What are the limitations of food balance sheets? (select all that apply)?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Accurate information on food production is always guaranteed', 'They account for the impact of climate change on food availability', 'They take into account the consumption of processed and packaged food items', 'All of the options given are correct', 'They provide a comprehensive overview of the nutritional status of a population', 'They provide real-time data on food availability and consumption', 'They always include data on home-grown and locally sourced food items']\",\"question\":\"What are the limitations of food balance sheets? (select all that apply)?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}