{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b69de6c8-7fe4-5e1f-8e8b-f35119cb55a4","task_key":"all--test--b69de6c8-7fe4-5e1f-8e8b-f35119cb55a4","task_revision_id":"1","upstream_id":"","short_description":"Interest groups representing businesspeople and investors are often among the…","config":"all","split":"test","body":"{\"choices\":\"['Such groups have the financial resources to mount sustained campaigns on their own behalf.', 'Many such groups have been in existence for several decades or more, allowing them to master the legislative system and to develop close ties with legislators.', \\\"In many districts, these groups' constituents make up the majority of voters.\\\", \\\"These groups' constituents contribute heavily to many legislators' campaigns, and in doing so, gain greater access to legislators.\\\"]\",\"question\":\"Interest groups representing businesspeople and investors are often among the most successful lobbying groups in Washington, D.C., for all of the following reasons EXCEPT\",\"subject\":\"high_school_government_and_politics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}