{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"970d7daf-6773-5871-b00a-ad12be957e34","task_key":"default--test--2183","task_revision_id":"1","upstream_id":"2183","short_description":"Why are parallel memory codes so important in the understanding of the role of…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Parallel storage duplicates information across different brain regions, leading to multiple identical memories', 'Parallel storage allows simultaneous storage of information, activating it from different sources after an experience and contributing to both memory and thinking.', 'Parallel storage enables the brain to process information sequentially rather than simultaneously', 'Parallel storage helps in storing large volumes of data', 'Parallel storage helps in quickly retrieving information', 'Parallel storage helps in organizing information', \\\"Parallel storage increases the brain's reliance on single-threaded processing\\\", 'Parallel storage compresses data for compact storage, but does not affect thinking', 'Parallel storage ensures complete accuracy in memory recall without any distortions', 'Parallel storage is important for creating long-term memories, but has no impact on immediate thought processes']\",\"question\":\"Why are parallel memory codes so important in the understanding of the role of memory in thought?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}