{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d865f6ed-40ba-5330-ac86-94ee3f7fe02d","task_key":"default--test--9822","task_revision_id":"1","upstream_id":"9822","short_description":"A student pushes a puck across a table, moving it from position x = 0 to…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The net force is in the negative direction, because the puck is moving in the positive direction but slowing down.', 'The net force is in the negative direction, because the student’s push caused the puck to slow down in the positive direction.', 'The net force is down, because the puck is near the Earth, where gravitational acceleration is 10 m/s^2 downward.', 'The net force is in the positive direction, because the force of friction is in the negative direction.', 'The net force is up, because the puck is near the Earth, where gravitational acceleration is 10 m/s^2 upward.', 'The net force is in the positive direction, because the puck is moving in the positive direction.', 'The net force is zero, because the student’s push in the positive direction must equal the force of friction in the negative direction.', 'The net force is zero, because the puck is in motion and not accelerating.', 'The net force is in the positive direction, because the student’s push caused the puck to speed up in the positive direction.', 'The net force is zero, because the puck is at rest at position x = 1.0 m.']\",\"question\":\"A student pushes a puck across a table, moving it from position x = 0 to position x = 0.2 m. After he lets go, the puck continues to travel across the table, coming to rest at position x = 1.2 m. When the puck is at position x = 1.0 m, which of the following is a correct assertion about the net force on the puck?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}