{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b142fcd-419f-5d07-8230-d3c1f5fd833f","task_key":"default--test--5875","task_revision_id":"1","upstream_id":"5875","short_description":"Sociologists like Bordo (1993) have attributed the 'epidemic' of anorexia in…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['the rise in stress and anxiety levels in modern society', 'a generally ascetic, frugal lifestyle that can be taken to extremes', 'the increase in fast food consumption and obesity', 'the lack of awareness about healthy diet and exercise', \\\"the social construction of mental illness, through which 'normal' patterns of behaviour are pathologized\\\", 'traditional images of women as emotional, domesticated, and unassertive', 'the new ideal of independent, self-assured femininity, combined with cultural values of achievement and control']\",\"question\":\"Sociologists like Bordo (1993) have attributed the 'epidemic' of anorexia in Western cultures to:\",\"src\":\"ori_mmlu-sociology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}