{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae72663f-697a-5a92-b6b4-904cbe266608","task_key":"default--test--9420","task_revision_id":"1","upstream_id":"9420","short_description":"Which of the following concerning uniform circular motion is true?","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['A satellite undergoing uniform circular motion is falling toward the center in a circular path.', 'The centripetal acceleration and velocity point in the same direction.', 'The centripetal acceleration and velocity point in opposite directions.', 'The acceleration of the object in motion changes whereas the velocity is constant.', 'The centrifugal force and the centripetal force cancel each other out in uniform circular motion.', 'The centrifugal force is greater than the centripetal force in uniform circular motion.', 'A satellite undergoing uniform circular motion is moving away from the center in a circular path.', 'The centripetal force acts in the same direction as the velocity.', 'The centrifugal force is the action-reaction pair of the centripetal force.']\",\"question\":\"Which of the following concerning uniform circular motion is true?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}