{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"30e4d511-df9f-57d7-ab19-0f4d7d6d89a3","task_key":"all--test--30e4d511-df9f-57d7-ab19-0f4d7d6d89a3","task_revision_id":"1","upstream_id":"","short_description":"What role does 'Information' play in the economic science of decision making?","config":"all","split":"test","body":"{\"choices\":\"[\\\"Information is not important to decision making in economic theory; rather, it is an actor's perceptions of situations that will inform their decision making process.\\\", 'Information has no special significance to economic decision making, which is guided more by external forces that coerce actors than their own rational choices.', \\\"Information plays a significant role in decision making because, although theory asserts that actors act in their own best interest, 'rational action' depends on the information available to them at the time.\\\", 'Information has become an important resource in the 21st century and can be sold and traded as a market commodity.']\",\"question\":\"What role does 'Information' play in the economic science of decision making?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}