{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8df4e2b3-aebd-5a5c-904c-1a0b50602042","task_key":"default--test--2746","task_revision_id":"1","upstream_id":"2746","short_description":"Discuss the evidence which supports the theory that there are two different…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Visual encoding is managed by the cerebellum, and verbal encoding is managed by the occipital lobe.', 'Visual information is processed in the frontal lobe, while verbal information is stored in the temporal lobe.', 'Both visual and verbal encoding are processed in the temporal lobes, with no distinction between the two.', 'There is only one encoding and memory system that handles both visual and verbal information.', 'Visual and verbal encoding and memory systems are completely separate without any overlap.', 'The hippocampus is solely responsible for visual memory, whereas the amygdala handles verbal memory.', 'Verbal learning is associated with the parietal lobe, while visual learning is not processed in the brain.', 'Only the left side of the brain is responsible for both visual and verbal learning.', 'The right side of the brain is the locus of spatial or visual information handling, while the left side is responsible for verbal learning and memory.', 'Verbal and visual memory systems are localized in the same hemisphere of the brain.']\",\"question\":\"Discuss the evidence which supports the theory that there are two different encoding and memory systems--visual and verbal.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}