{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4e2fdd7-91e8-5dd1-a280-fde4c9b0b205","task_key":"all--test--c4e2fdd7-91e8-5dd1-a280-fde4c9b0b205","task_revision_id":"1","upstream_id":"","short_description":"A very slow-moving positron interacts with a stationary electron. Which of the…","config":"all","split":"test","body":"{\"choices\":\"['Conservation of mass indicates that if a single new particle were created in the reaction, it must have a total mass equal to the combined masses of the electron and positron.', 'Conservation of charge indicates that all new particles created in the reaction would have no electric charge.', 'Conservation of momentum indicates that two identical gamma rays moving off in opposite directions could be created.', 'Conservation of energy indicates that the antimatter positron could annihilate into energy, leaving the stationary electron behind.']\",\"question\":\"A very slow-moving positron interacts with a stationary electron. Which of the following statements correctly describes a possible outcome of this reaction and why it would occur?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}