{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53605202-277c-5c31-baed-4215b6f4ea9d","task_key":"default--test--360","task_revision_id":"1","upstream_id":"360","short_description":"Businesses have _____ within society and have the potential to provide a ____ to…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Little power, Small contribution, Business malpractice', 'Minimal power, No contribution, Business malpractice', 'Huge power, Small contribution, Corporate social responsibility', 'Huge power, No contribution, Corporate social responsibility', 'Little power, Major contribution, Corporate social responsibility', 'Significant power, Major contribution, Business malpractice', 'Little power, Major contribution, Business ethics', 'Minimal power, Significant contribution, Corporate social responsibility', 'Significant power, Minor contribution, Corporate social responsibility', 'Huge power, Major contribution, Business malpractice']\",\"question\":\"Businesses have _____ within society and have the potential to provide a ____ to society while ____ has the potential to inflict enormous harm on individuals, communities and the environment.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}