{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"229b40b1-c3ec-5909-87ca-25e1679d0dcb","task_key":"default--test--9893","task_revision_id":"1","upstream_id":"9893","short_description":"A racing car passes one end of the grandstand at a speed of 50 ft/sec. It slows…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Acceleration is -1 ft/sec^2 and the length of the grandstand is 800 ft', 'Acceleration is -3 ft/sec^2 and the length of the grandstand is 500 ft', 'Acceleration is -2 ft/sec^2 and the length of the grandstand is 500 ft', 'Acceleration is -1 ft/sec^2 and the length of the grandstand is 700 ft', 'Acceleration is -0.5 ft/sec^2 and the length of the grandstand is 800 ft', 'Acceleration is -1.5 ft/sec^2 and the length of the grandstand is 750 ft', 'Acceleration is -2 ft/sec^2 and the length of the grandstand is 600 ft', 'Acceleration is -2 ft/sec^2 and the length of the grandstand is 700 ft', 'Acceleration is -1.5 ft/sec^2 and the length of the grandstand is 650 ft', 'Acceleration is -2.5 ft/sec^2 and the length of the grandstand is 550 ft']\",\"question\":\"A racing car passes one end of the grandstand at a speed of 50 ft/sec. It slows down at a constant acceleration a\\\\ding{217}, such that its speed as it passes the other end of the grandstand is 10 ft/sec. (a) If this pro-cess takes 20 seconds, calculate the acceleration a\\\\ding{217} and (b) the length of the grandstand .\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}