{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e5b9bc55-4c2d-579a-a948-79474b116356","task_key":"default--test--6516","task_revision_id":"1","upstream_id":"6516","short_description":"It is correct to state about the epidemiology of Anorexia Nervosa that:","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Prevalence rates are 2% for female adolescents', 'Males from any socioeconomic background can be affected', 'Prevalence rates are 10% for male adolescents', 'It only affects individuals from high socioeconomic backgrounds', 'It affects males and females equally', 'Only females from low socioeconomic backgrounds can be affected', 'It is most common in middle-aged females', 'Prevalence rates are highest among males in their 40s', 'It never happens in children or post menopausal women']\",\"question\":\"It is correct to state about the epidemiology of Anorexia Nervosa that:\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}