{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dda359d8-b327-51b6-86b8-d99c94aab163","task_key":"default--test--6293","task_revision_id":"1","upstream_id":"6293","short_description":"One reason that older adults may have difficulty in retrieving memories is that","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['There are many more memories to search through to find the one that is sought', 'The aging brain is less capable of accessing long-term memory', 'Memory is less well organized as we grow older and finding a memory can be quite difficult', 'Older adults intentionally suppress certain memories', 'Memory retrieval is physically tiring for older adults', 'Older adults are less capable of forming new memories', 'Long-term memory often discards older and unused memories', 'Memory retrieval is often affected by external distractions faced by older adults', 'The process of memory retrieval slows down significantly with age', 'Older adults quit searching because they have more important things to do']\",\"question\":\"One reason that older adults may have difficulty in retrieving memories is that\",\"src\":\"ori_mmlu-human_aging\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}