{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb3f4044-c9b9-58b2-a888-fb8f6fdc54d5","task_key":"default--test--6783","task_revision_id":"1","upstream_id":"6783","short_description":"With respect to theories of senescence, it's probably safe to say that","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Programmed theories are the best we have at present', 'Only one theory can accurately explain senescence', 'All of these theories are merely speculation at this point', 'All of these theories have been widely accepted by the scientific community', 'Theories of senescence are being disproven at a rapid rate', 'The evidence for these theories is insufficient and not compelling', 'Many theories will have to be combined to explain senescence', 'Senescence is not yet fully understood and cannot be explained by any theory', 'Programmed theories are completely incorrect', 'The evidence for these theories is direct and quickly accumulating']\",\"question\":\"With respect to theories of senescence, it's probably safe to say that\",\"src\":\"ori_mmlu-human_aging\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}