{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00f717c9-f2be-528e-848c-329dcc6623e8","task_key":"all--test--00f717c9-f2be-528e-848c-329dcc6623e8","task_revision_id":"1","upstream_id":"","short_description":"Consider a profit-maximizing firm in a perfectly competitive market with several…","config":"all","split":"test","body":"{\"choices\":\"['reduce the firm’s employment level, because fewer workers are now needed', 'raise the workers’ hourly wage as they now contribute more marginal revenue', 'lead the firm to hire more workers but not to raise their wages', 'lead the firm to hire more workers and to pay them higher wages']\",\"question\":\"Consider a profit-maximizing firm in a perfectly competitive market with several sellers and several buyers (i.e., the firm is a \\\"price taker\\\" of the goods it sells and a \\\"price taker\\\" of the hourly wages it pays its workers). If a technological innovation made by someone in this firm were to significantly raise the firm's marginal physical product (but not that of any other firm's), then this innovation would\",\"subject\":\"high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}