{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8ba19b3d-cd89-597e-b5ac-dd0ee51c08c6","task_key":"all--test--8ba19b3d-cd89-597e-b5ac-dd0ee51c08c6","task_revision_id":"1","upstream_id":"","short_description":"What is one reason why the government discourages collusion between large firms…","config":"all","split":"test","body":"{\"choices\":\"['Collusive output levels tend to increase, driving the price above competitive levels.', 'Consumer surplus falls as the price is driven downward.', 'Collusive output levels tend to decrease, driving the price down to competitive levels.', 'Joint profit maximization costs society consumer surplus as the price rises above competitive levels.']\",\"question\":\"What is one reason why the government discourages collusion between large firms in the same industry?\",\"subject\":\"high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}