{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"46093252-6aa7-582a-ba72-b037887b6c91","task_key":"all--test--46093252-6aa7-582a-ba72-b037887b6c91","task_revision_id":"1","upstream_id":"","short_description":"One of the reasons that the government discourages and regulates monopolies is…","config":"all","split":"test","body":"{\"choices\":\"['producer surplus is lost and consumer surplus is gained.', 'monopoly prices ensure productive efficiency but cost society allocative efficiency.', 'monopoly firms do not engage in significant research and development.', 'consumer surplus is lost with higher prices and lower levels of output.']\",\"question\":\"One of the reasons that the government discourages and regulates monopolies is that\",\"subject\":\"high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}