{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"01952385-bb98-5dec-a50f-95546d104b3a","task_key":"default--test--620","task_revision_id":"1","upstream_id":"620","short_description":"There are a number of means by which can influence _______. These include…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Employees, Breadth of transmission, Content, Avenue of approach', 'Consumers, Avenue of approach, Breadth of transmission, Content', 'Government, Breath of transmission, Avenue of approach, Content', 'Government, Height of transmission, Content, Avenue of approach', 'Consumers, Avenue of approach, Height of transmission, Content', 'Employees, Avenue of approach, Height of transmission, Content', 'Employees, Content, Avenue of approach, Breadth of transmission', 'Government, Avenue of approach, Breadth of transmission, Content', 'Government, Content, Breadth of transmission, Avenue of approach', 'Consumers, Content, Height of transmission, Avenue of approach']\",\"question\":\"There are a number of means by which can influence _______. These include _________to decision maker, varying from very direct modes to indirect modes, _________, being either public or private and ________ of communication.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}