{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"24f5ee38-4e06-5b90-8597-4bb389b59203","task_key":"default--test--2242","task_revision_id":"1","upstream_id":"2242","short_description":"What is attention? Include a description of the \"energy\" and \"analytic…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"Attention is the brain's method of processing every detail in the environment simultaneously\\\", 'Attention is a process of memory retention', 'Attention is the ability to perceive all stimuli equally', 'Attention is an unconscious filtering process that operates without the allocation of energy or analytic mechanisms', 'Attention is the ability to multitask', 'Attention is the capacity to attend to certain stimuli and has been explained traditionally as an allocation of energy or a focusing of analyzing neural mechanisms on a part of the stimulus input field.', 'Attention is a fixed resource allocated randomly to various tasks', 'Attention is a purely emotional response to stimuli without any energy or analytic mechanisms involved', \\\"Attention is the brain's ability to enhance sensory perception through increasing the volume of input\\\", 'Attention is the reduction of sensory input to manage cognitive load']\",\"question\":\"What is attention? Include a description of the \\\"energy\\\" and \\\"analytic mechanism\\\" approaches.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}