{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85e931a6-26a8-5df0-8b66-00d504f87774","task_key":"default--test--2787","task_revision_id":"1","upstream_id":"2787","short_description":"Discuss the psychological effects of marijuana intoxicationincluding its effects…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Marijuana intoxication has no effect on cognitive processes or emotions', 'Marijuana intoxication primarily affects memory, with no significant impact on perception, emotions, or cognitive processes.', 'Marijuana intoxication dulls perception and decreases sensory experiences', 'Marijuana intoxication causes a significant increase in long-term memory retention and sharpens identity perception.', 'Marijuana intoxication has a temporary enhancing effect on academic and physical performance.', 'Marijuana intoxication improves memory and increases movement', 'Marijuana intoxication enhances perception, increases sensory pleasure, amplifies emotions, alters cognitive processes, affects memory, changes identity perception, affects time sense and decreases movement.', 'Marijuana intoxication leads to enhanced cognitive processes and improved problem-solving abilities.', 'Marijuana intoxication induces a state of unaltered emotions and leaves the sense of identity and time perception intact.', 'Marijuana intoxication results in heightened time sense accuracy and faster reaction times.']\",\"question\":\"Discuss the psychological effects of marijuana intoxicationincluding its effects on perception, emotions, cognitive processes, memory, identity, time sense, performance.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}