{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1346c30b-2dde-5ec6-9c38-1e586bf1a9d6","task_key":"all--test--1346c30b-2dde-5ec6-9c38-1e586bf1a9d6","task_revision_id":"1","upstream_id":"","short_description":"If consumers are advised that multigrained bread will substantially lessen the…","config":"all","split":"test","body":"{\"choices\":\"['The demand curve will shift to the left, decreasing the price of multigrained bread.', 'The supply curve will shift to the left, increasing the price of multigrained bread.', 'The demand curve will shift to the right, increasing the price of multigrained bread.', 'The supply curve will shift to the right, decreasing the price of multigrained bread.']\",\"question\":\"If consumers are advised that multigrained bread will substantially lessen the risk of cancer, which of the following will happen in the market for multigrained bread?\",\"subject\":\"high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}