{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7a772665-c54c-5de9-8937-a2b3037a3a44","task_key":"default--test--190","task_revision_id":"3","upstream_id":"190","short_description":"What are the three differing types of stakeholder theory according to Donaldson…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Normative, Political and Economic', 'Political, Descriptive and Economic', 'Normative, Moral and Instrumental', 'Normative, Descriptive and Political', 'Normative, Moral and Economic', 'Normative, Instrumental and Economic', 'Moral, Descriptive and Instrumental', 'Normative, Descriptive and Instrumental', 'Political, Descriptive and Instrumental', 'Normative, Descriptive and Economic']\",\"question\":\"What are the three differing types of stakeholder theory according to Donaldson and Preston (1995)?\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}