{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2b8a2420-e1a6-5b00-9564-cade28835046","task_key":"default--test--6784","task_revision_id":"1","upstream_id":"6784","short_description":"Older adults are able to improve their memories and reduce their anxiety about…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['They engage in social activities and interact with peers', 'They practice mindfulness and meditation to reduce stress levels', 'They engage in physical activity regularly', 'They regularly solve puzzles and engage in brain-stimulating activities', 'They learn that many aspects of memory do not decline and some even get better', 'They simply learn a number of memory improvement techniques', 'They take memory-enhancing medications', 'They learn about memory and aging and learn some techniques', 'They consume a diet rich in antioxidants and omega-3 fatty acids', 'Older adults cannot do either of these']\",\"question\":\"Older adults are able to improve their memories and reduce their anxiety about declining memory when\",\"src\":\"ori_mmlu-human_aging\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}