{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8f1c0054-4283-5dde-888f-50fdb03a5113","task_key":"default--test--2790","task_revision_id":"1","upstream_id":"2790","short_description":"Devise an experiment which would distinguish between Decay and Interference…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Decay Theory is supported if the experimental group recalls significantly more than the control group, indicating that time strengthens memories. Interference Theory is supported if recall is unaffected by additional learning tasks.', 'Interference Theory is supported if the control group recalls more than the experimental group when a competing task is introduced immediately after learning, indicating that immediate interference affects recall.', 'Interference Theory is supported if both groups recall the same amount from learning task A', 'Decay Theory is supported if the recall is unaffected over time, while Interference Theory is supported if recall decreases with the introduction of a competing task shortly after learning.', 'Decay Theory is supported if the experimental group demonstrates improved recall with the introduction of a competing task, indicating that interference can actually enhance memory retention.', 'Decay Theory is supported if both groups recall the same amount from learning task A, proving that time fades memories. Interference Theory is supported if the experimental group recalls significantly less than the control group, indicating interference from other memories', 'Decay Theory is supported if the experimental group recalls significantly less than the control group', 'Decay Theory is supported if recall diminishes in the absence of any competing tasks over a long period, indicating that memories fade naturally over time. Interference Theory is supported if recall diminishes only when a competing task is introduced during the retention interval.', 'Both theories are supported if the control group recalls significantly less than the experimental group', 'Interference Theory is supported if both groups show improved recall over time, suggesting that memories consolidate rather than decay or interfere with each other.']\",\"question\":\"Devise an experiment which would distinguish between Decay and Interference theories of forgetting. What results would have to be obtained to support the Decay theory? To support the Interference theory?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}