{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"657e7c46-1927-5bdd-90b0-838eff4bb47d","task_key":"default--test--2553","task_revision_id":"1","upstream_id":"2553","short_description":"Discuss the effects of sleep deprivation.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Decreased blood pressure, heightened sensory perception, faster reaction times', 'Strengthened cognitive abilities, longer lifespan, better pain tolerance', 'Enhanced problem-solving skills, increased emotional stability, improved coordination', 'Sharper focus, accelerated learning ability, increased creativity', 'Improved cardiovascular health, reduced inflammation, increased energy levels', 'Slower metabolism, improved immune function, enhanced muscle growth', 'Increased productivity, enhanced memory, heightened alertness', 'Improved mood, decreased stress, better concentration', 'Behavioral changes, hallucinations, psychotic-like behavior, decrease in alpha brain waves, low voltage EEG']\",\"question\":\"Discuss the effects of sleep deprivation.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}