{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d1280b2d-09a9-5567-b4ca-a5f5e7d9dab6","task_key":"default--test--3345","task_revision_id":"1","upstream_id":"3345","short_description":"Discuss some of the elements found in advanced animal societies.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Language development, agricultural practices, and written communication are elements found in advanced animal societies.', 'Economic systems, legal structures, and political elections are elements found in advanced animal societies.', 'Adaptation, evolution and species diversity are elements found in advanced animal societies.', 'Cultural traditions, artistic expression, and philosophy are elements found in advanced animal societies.', 'Leadership, territory and dominance hierarchy are elements found in advanced animal societies.', 'Family structure, food chains and migration patterns are elements found in advanced animal societies.', 'Habitat selection, mating rituals and parental care are elements found in advanced animal societies.']\",\"question\":\"Discuss some of the elements found in advanced animal societies.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}