{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f4fda0c5-8c6a-5c99-ab0d-5eea1a210176","task_key":"default--test--6213","task_revision_id":"1","upstream_id":"6213","short_description":"One line of evidence against antagonistic pleiotropy is that","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Exercise increases rather than decreases longevity', 'Senescence can also be observed in cells with short telomere strands', 'Women who have more children tend to live longer', 'Certain species have shown no signs of aging', 'The genetic mutation rate increases with age', 'Even tissue cells with longer telomere strands can show senescence', 'Senescence is observed in all living organisms', 'Caloric restriction extends lifespan in many species', 'Some animals show little or no senescence', 'Organisms with fewer offspring have a longer lifespan']\",\"question\":\"One line of evidence against antagonistic pleiotropy is that\",\"src\":\"ori_mmlu-human_aging\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}