{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5fdf5300-e1a6-5e90-83a5-a193f3716773","task_key":"default--test--3375","task_revision_id":"1","upstream_id":"3375","short_description":"The dorsal root of a nerve leading to the leg of a rat is severed. How will this…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Severing the ventral root results in loss of motor function, but sensation remains intact.', 'Severing the dorsal root causes hyperactivity in movement, while severing the ventral root leads to increased sensation.', 'Severing the dorsal root will lead to loss of sensation and reflex action, but if the ventral root is severed, the rat would sense the stimulation but would not be able to react.', 'Severing the dorsal root has no impact on sensation or motor function, while severing the ventral root causes tremors.', \\\"Severing the dorsal root won't have an effect\\\", 'Severing the dorsal root causes a loss of motor function, whereas severing the ventral root has no effect on the rat.', 'Both the dorsal and ventral root severing lead to enhanced reflex actions.', 'Severing either root causes paralysis', 'Severing the dorsal root results in enhanced sensation, but severing the ventral root causes complete paralysis.', 'Severing the ventral root causes loss of sensation']\",\"question\":\"The dorsal root of a nerve leading to the leg of a rat is severed. How will this affect the rat? How would the effect vary if the ventral root were severed instead?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}