{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d73ad09e-84c9-53ea-ae9c-c64cb9a9e87e","task_key":"default--test--9537","task_revision_id":"1","upstream_id":"9537","short_description":"A ball of mass is attached to a string connected to the ceiling, forming a…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Releasing the string from a higher point', 'Increasing the angle of the string from the horizontal when released', 'Decreasing the angle of the string from the horizontal when released', 'Decreasing the mass of the ball', 'Increasing the length of the string', 'Releasing the ball from a lower point', 'Decreasing the length of the string', 'Increasing the mass of the ball', 'Decreasing the gravity acting on the ball']\",\"question\":\"A ball of mass is attached to a string connected to the ceiling, forming a pendulum. When the string is raised to an angle of 50 degrees below the horizontal (the ceiling) and released, the ball swings back and forth with a period of 0.4 s. Which of the following changes to the pendulum would decrease the period of the pendulum?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}