{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"621fe62e-a0b3-5684-aa5d-ea686f984ce4","task_key":"default--test--3148","task_revision_id":"1","upstream_id":"3148","short_description":"The dorsal root of a nerve leading to the leg of a rat is severed. How will this…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Both severing the dorsal and ventral roots cause increased sensation and reflex action.', 'Severing the dorsal root causes loss of motor function, severing the ventral root causes enhanced sensation.', 'Both severing the dorsal and ventral roots lead to complete paralysis of the affected part.', 'Severing the dorsal root causes enhanced movement, severing the ventral root has no effect.', 'Severing the dorsal root causes loss of sensation and reflex action, severing the ventral root causes inability to move the affected part.', 'Severing the dorsal root has no effect, severing the ventral root causes loss of sensation.', 'Severing the dorsal root causes paralysis, severing the ventral root causes heightened sensitivity.', 'Severing the dorsal root causes involuntary twitching, severing the ventral root causes loss of reflex action.', 'Severing the dorsal root causes increased reflex action, severing the ventral root causes loss of sensation.', 'Severing the dorsal root has no effect, severing the ventral root causes paralysis.']\",\"question\":\"The dorsal root of a nerve leading to the leg of a rat is severed. How will this affect the rat? How would the effect vary if the ventral root were severed instead?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}