{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f171b679-a45a-55e3-a74d-6e86badddd59","task_key":"all--test--f171b679-a45a-55e3-a74d-6e86badddd59","task_revision_id":"1","upstream_id":"","short_description":"If the perfectly competitive price is currently below minimum average total…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The price will rise and each firm's output will fall as firms exit the industry.\\\", 'Market equilibrium quantity will increase as firms exit the industry.', 'Nothing. The industry is currently in long-run equilibrium.', 'The price will rise to the breakeven point as firms exit the industry.']\",\"question\":\"If the perfectly competitive price is currently below minimum average total cost, we can expect which of the following events in the long run?\",\"subject\":\"high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}