{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3fca4c4f-bb8a-5136-ba32-61ba8b71fba7","task_key":"all--test--3fca4c4f-bb8a-5136-ba32-61ba8b71fba7","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is not a purportedly beneficial outcome of the…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The redistribution of wealth, addressing disparities in economic and resource allocation across the globe through a sense of greater 'interconnectedness'.\\\", 'The growing sense of global community, resulting in super-national identities that result from populations feeling closer to one another.', 'The sharing of ideas, technologies and resources that can directly benefit human security, such as medical advancements.', 'A global market that has demonstrated the ability, if left unchecked, to reduce poverty and make substantial economic gains.']\",\"question\":\"Which of the following is not a purportedly beneficial outcome of the globalization process?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}