{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2bc4891d-f9da-5b9b-af4d-d840a2674497","task_key":"default--test--6394","task_revision_id":"1","upstream_id":"6394","short_description":"Each of the following are aspects of the McDonaldization of Society EXCEPT:","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The extensive use of technology in everyday life', 'Rationalization of decisions into cost/benefit analysis structures and away from traditional modes of thinking', 'A focus on efficiency and predictability in all aspects of society', 'An intense effort on achieving sameness across diverse markets', 'Increased emphasis on quantity over quality', 'The prioritization of profit over societal well-being', 'Bureaucratic organization that formalizes well-establish division of labor and impersonal structures', 'The standardization of societal norms and practices', 'A shift from individual craftsmanship to mass production', 'A dissolution of hierarchical modes of authority into collaborative teambased decision protocols']\",\"question\":\"Each of the following are aspects of the McDonaldization of Society EXCEPT:\",\"src\":\"ori_mmlu-college_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}