{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ac16dbd-c41e-5867-9c43-d5ed3c2a1316","task_key":"default--test--3224","task_revision_id":"1","upstream_id":"3224","short_description":"What is mutualism? Give three examples of this type of relationship.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Mutualism is a relationship where one species benefits and the other is harmed. Examples include: the clownfish and sea anemone, oxpeckers and rhinos, and honeybees and flowers.', 'Mutualism is a relationship where one species benefits and the other is unaffected. Examples include: barnacles on whales, remoras on sharks, and orchids growing on trees.', 'In the mutualistic type of relationship, both species benefit from each other. Examples include: Nitrogen-fixing bacteria of the genus Rhizobium and legumes, lichens which are a combination of fungi and algae, and ants and aphids or scale insects.', 'Only one species benefits in mutualism', 'Mutualism is a relationship where both species are harmed. Examples include: parasitic wasps and caterpillars, mistletoe and trees, and tapeworms and mammals.', 'Mutualism is a type of relationship where both species compete for resources. Examples include: different tree species in a forest, coral and algae, and various species of scavengers on a carcass.', 'Mutualism does not occur in plants', 'Mutualism refers to the relationship between predator and prey. Examples include: cheetahs and gazelles, wolves and deer, and hawks and rodents.', 'Examples of mutualism include lion and gazelle, cat and mouse, wolf and rabbit', 'Examples of mutualism include sharks and remoras, crocodiles and plover birds, and humans and domesticated animals.']\",\"question\":\"What is mutualism? Give three examples of this type of relationship.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}