{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d9db1d75-1ca8-5e59-9105-9502bde8e29c","task_key":"default--test--6402","task_revision_id":"1","upstream_id":"6402","short_description":"Which of the following is most strongly associated with loss of bone density?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Environmental factors such as exposure to radiation', 'Genetic factors', 'Psychological factors such as stress levels', 'Atmospheric factors such as air pollution', 'Socioeconomic factors such as income level', 'Dietary factors such as excessive intake of protein', 'Cohort factors', 'Lifestyle factors like not exercising', 'Hormonal factors such as loss of estrogen', 'Age-related factors such as early childhood development']\",\"question\":\"Which of the following is most strongly associated with loss of bone density?\",\"src\":\"ori_mmlu-human_aging\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}