{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1c1f444a-497f-5c9a-90c1-32f5d317eac2","task_key":"all--test--1c1f444a-497f-5c9a-90c1-32f5d317eac2","task_revision_id":"1","upstream_id":"","short_description":"Given the table below which statement is true? Labor hours needed to produce a…","config":"all","split":"test","body":"{\"choices\":\"['France has the absolute advantage in both products.', 'France should specialize in and export wine while Belgium should specialize in and export cheese.', 'France has the comparative advantage in cheese.', 'France has the absolute advantage in cheese.']\",\"question\":\"Given the table below which statement is true? Labor hours needed to produce a unit of: Country      Wine      Cheese France      40      80 Belgium      15      60\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}