{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3da93f69-2e25-5ae5-a072-b561f44d5405","task_key":"default--test--3341","task_revision_id":"1","upstream_id":"3341","short_description":"If a ring is cut through the bark all the way around a tree, down to the wood,…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"[\\\"The cut inhibits the tree's ability to produce new bark, leaving it vulnerable to external elements and pests.\\\", 'The cut interrupts the flow of gases to and from the leaves, leading to suffocation of the tree.', 'The tree will die because it gets infected through the cut', 'The ring cut causes the tree to dry out as it prevents sap from flowing through the bark.', 'The tree dies because the cut prevents the production of chlorophyll, which is essential for photosynthesis.', \\\"The tree will die because the cut disrupts the flow of energy from the leaves to the roots, leading to the roots' starvation.\\\", 'The tree will eventually die because the cut severs the vascular system, preventing water and nutrients from being transported from the roots to the upper part of the tree and vice versa. This leads to a gradual loss of turgidity, closure of stomata, suspension of photosynthesis, and exhaustion of food reserves.', 'The tree will die because it can no longer grow taller', 'The tree will live indefinitely as the cut only affects the outer appearance and does not interfere with any vital processes.', 'The tree dies due to the physical damage caused by the cut']\",\"question\":\"If a ring is cut through the bark all the way around a tree, down to the wood, the tree will live for a while, then die. Explain why.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}