{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b42dcf74-6170-55af-836f-7a55b0691c88","task_key":"all--test--b42dcf74-6170-55af-836f-7a55b0691c88","task_revision_id":"1","upstream_id":"","short_description":"Which one of the following statements is true concerning the motion of an ideal…","config":"all","split":"test","body":"{\"choices\":\"['The acceleration vector points opposite to the velocity vector on the way up and in the same direction as the velocity vector on the way down.', 'The speed at the top of the trajectory is zero.', \\\"The object's total speed remains constant during the entire flight.\\\", 'The vertical speed decreases on the way up and increases on the way down.']\",\"question\":\"Which one of the following statements is true concerning the motion of an ideal projectile launched at an angle of 45° to the horizontal?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}