{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d2f05c43-9db4-51a1-9f03-8b3c8c85dac9","task_key":"default--test--6624","task_revision_id":"1","upstream_id":"6624","short_description":"What is food security?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['It is about ensuring that food prices are controlled and affordable for everyone.', 'It relates to efforts to prevent terrorists from poisoning food supplies.', 'Its component elements include availability, utilisation, and stability, as well as access.', 'Food security involves the development of genetically modified crops to increase yield.', 'It is an initiative to protect food supplies from natural disasters.', \\\"It is about ensuring everyone's access to food.\\\", 'Food security focuses primarily on ending micronutrient malnutrition.', \\\"It is the system of producing enough food to feed a country's population.\\\", 'Food security refers to the protection of agricultural land.']\",\"question\":\"What is food security?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}