{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3fc6a4a-a6dd-5bbc-9f7e-960ec3ac6327","task_key":"default--test--2741","task_revision_id":"1","upstream_id":"2741","short_description":"What is proactive interference and what does it indicate about how information…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Retroactive interference is when past memories hinder the learning of new information, while proactive interference is when new information enhances the recall of old memories.', 'Retroactive interference is the effect of new information on the recall of previously learned information', 'Proactive interference is the enhancement of future memory retention due to past information, while retroactive interference is the inability to forget unimportant details.', 'Retroactive interference is the process of past memories aiding the retention of new information, while proactive interference is when new learning disrupts the recall of future information.', 'Proactive interference refers to the inability to recall new information', 'Proactive interference is the effect of prior learned items on the retention of information, indicating the importance of classification in retention. Retroactive interference refers to the effect the last items learned have on the retention of information.', 'Proactive interference is the inability to learn new information because of existing knowledge, while retroactive interference is the improvement of memory retention due to new information.', 'Proactive interference occurs when the memorization of new information is facilitated by previously learned information, and retroactive interference is the process where past information is confused with new learning.', 'Proactive interference is the process by which future information is predicted based on past memories, and retroactive interference is when new information overwrites old memories.', 'Proactive interference is the effect of future learned items on the retention of information']\",\"question\":\"What is proactive interference and what does it indicate about how information is classified? What is retroactive interference?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}