{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00bb5267-5011-56cc-8bb4-01a91740f038","task_key":"all--test--00bb5267-5011-56cc-8bb4-01a91740f038","task_revision_id":"1","upstream_id":"","short_description":"Two ice skaters are moving on frictionless ice and are about to collide. The…","config":"all","split":"test","body":"{\"choices\":\"['The linear momentum of the system is conserved because the net force on the system is nonzero during the collision.', 'Only the kinetic energy of the system is conserved because it is an inelastic collision.', 'Only the kinetic energy of the system is conserved because it is an elastic collision.', 'The linear momentum of the system is conserved because the net force on the system is zero.']\",\"question\":\"Two ice skaters are moving on frictionless ice and are about to collide. The 50-kg skater is moving directly west at 4 m/s. The 75-kg skater is moving directly north at 2 m/s. After the collision they stick together. For this scenario, which of the following is true?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}