{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"28bbb5b6-b642-5a16-bbf7-89ded498deb2","task_key":"default--test--754","task_revision_id":"1","upstream_id":"754","short_description":"According Carroll what four categories or aspects can corporate social…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Political, Legal, Ethical and Philanthropic', 'Economic, Legal, Ethical and Moral', 'Economic, Legal, Ethical and Environmental', 'Economic, Legal, Ethical and Philanthropic', 'Political, Legal, Cultural and Philanthropic', 'Economic, Legal, Humanitarian and Philanthropic', 'Economic, Legal, Cultural and Philanthropic', 'Economic, Cultural, Ethical and Environmental', 'Political, Legal, Economic and Environmental', 'Political, Legal, Ethical and Environmental']\",\"question\":\"According Carroll what four categories or aspects can corporate social responsibility be broken down into?\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}