{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d9bc1480-64b9-5c2e-bfb1-190b0b8163ba","task_key":"default--test--9534","task_revision_id":"1","upstream_id":"9534","short_description":"Which one of the following statements is true concerning the motion of an ideal…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The horizontal speed decreases on the way up and increases on the way down.', 'The acceleration vector points opposite to the velocity vector on the way up and in the same direction as the velocity vector on the way down.', \\\"The object's total speed increases during the entire flight.\\\", 'The speed at the top of the trajectory is at its maximum.', 'The vertical speed increases on the way up and decreases on the way down.', \\\"The object's total speed decreases during the entire flight.\\\", 'The vertical speed decreases on the way up and increases on the way down.', 'The acceleration vector points in the same direction as the velocity vector on the way up and opposite to the velocity vector on the way down.', 'The speed at the top of the trajectory is zero.', \\\"The object's total speed remains constant during the entire flight.\\\"]\",\"question\":\"Which one of the following statements is true concerning the motion of an ideal projectile launched at an angle of 45° to the horizontal?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}