{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"edb0d568-1276-5727-b979-c864c1674967","task_key":"default--test--9111","task_revision_id":"1","upstream_id":"9111","short_description":"Two ice skaters are moving on frictionless ice and are about to collide. The…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Neither the kinetic energy nor the linear momentum of the system is conserved.', 'The linear momentum of the system is conserved because the net force on the system is zero.', 'The linear momentum of the system is not conserved because the net force on the system is zero.', 'Only the kinetic energy of the system is conserved because it is an inelastic collision.', 'Both the kinetic energy and linear momentum of the system are conserved because it is an elastic collision.', 'The linear momentum of the system is not conserved because the net force on the system is nonzero during the collision.', 'Only the kinetic energy of the system is conserved because the collision is frictionless.', 'Only the kinetic energy of the system is conserved because it is an elastic collision.', 'The linear momentum of the system is conserved because the net force on the system is nonzero during the collision.', 'The linear momentum of the system is conserved because the net force on the system is nonzero.']\",\"question\":\"Two ice skaters are moving on frictionless ice and are about to collide. The 50-kg skater is moving directly west at 4 m/s. The 75-kg skater is moving directly north at 2 m/s. After the collision they stick together. For this scenario, which of the following is true?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}