{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d2cf92fe-16a0-58e5-ab10-3510676994f2","task_key":"default--test--753","task_revision_id":"1","upstream_id":"753","short_description":"In order to try and align the interest of shareholders and senior management of…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"[\\\"Performance bonuses, Shareholders, Company's Market Capitalization\\\", 'Non-financial remunerations, Board of directors, Employee Satisfaction', \\\"Share options, Board of directors, Company's Market Capitalization\\\", 'Non-financial remunerations, All employees, Employee Satisfaction', 'Non-financial remunerations, Senior managers, Employee Satisfaction', 'Performance bonuses, Senior managers, Company Profit', 'Performance bonuses, All employees, Company Profit', 'Share options, Senior managers, Share Price', 'Share options, All employees, Share Price', 'Share options, Shareholders, Share Price']\",\"question\":\"In order to try and align the interest of shareholders and senior management of a company, _________ are often made available to _______ of a company, to ensure that it is in their interests to increase _______ and dividend performance.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}