{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b448daa5-66a8-50a3-9112-7ad65c7650ca","task_key":"all--test--b448daa5-66a8-50a3-9112-7ad65c7650ca","task_revision_id":"1","upstream_id":"","short_description":"There are a number of means by which can influence _______. These include…","config":"all","split":"test","body":"{\"choices\":\"['Government, Avenue of approach, Breadth of transmission, Content', 'Consumers, Avenue of approach, Height of transmission, Content', 'Government, Breath of transmission, Avenue of approach, Content', 'Employees, Breadth of transmission, Content, Avenue of approach']\",\"question\":\"There are a number of means by which can influence _______. These include _________to decision maker, varying from very direct modes to indirect modes, _________, being either public or private and ________ of communication.\",\"subject\":\"business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}