{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d9950513-4573-5c92-8b5f-6ac01aad1a1c","task_key":"all--test--d9950513-4573-5c92-8b5f-6ac01aad1a1c","task_revision_id":"1","upstream_id":"","short_description":"In order to hire the least-cost combination of labor and capital, the firm must…","config":"all","split":"test","body":"{\"choices\":\"['Find the combination of labor and capital where the marginal product of labor is equal to the marginal product of capital.', 'Find the combination of labor and capital where the ratio of the marginal product of labor to the marginal product of capital is equal to one.', 'Find the combination of labor and capital where the marginal product of labor divided by the price of labor is equal to the marginal product of capital divided by the price of capital.', 'Find the combination of labor and capital where the price of labor is equal to the price of capital.']\",\"question\":\"In order to hire the least-cost combination of labor and capital, the firm must do which of the following?\",\"subject\":\"high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}