{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7e0bd7f-4eb5-5e75-9247-3d296cbda057","task_key":"default--test--2786","task_revision_id":"1","upstream_id":"2786","short_description":"Differentiate between sensation and percept.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Sensations and perception are the same process', \\\"Sensations provide us with basic elementary experiences which we further interpret into meaningful events. This interpretation of sensations is called 'perception.'\\\", 'Sensations are the interpretation of our senses', 'Sensations are the process by which our brain organizes and interprets sensory information.', 'Perception is the initial data collection through our sensory organs.', 'Sensations are the conscious experiences triggered by perception.', 'Perception occurs before sensations in the process of interpreting sensory information.', 'Perception is the mental reconstruction of sensations into our past experiences.', 'Sensations are the complex understanding of our environment, while perception is the initial sensory input.', 'Perception is the physical process of sensing the environment']\",\"question\":\"Differentiate between sensation and percept.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}