{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ebac377-9631-5f43-b5f7-86c5c258d816","task_key":"default--test--11591","task_revision_id":"1","upstream_id":"11591","short_description":"A container having an area of 1 ft^2 and a volume of 5 ft^3 holds2 ft^3 of an…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['V = 28 ft/sec, Z_max = 17 ft', 'V = 33 ft/sec, Z_max = 21.5 ft', 'V = 30 ft/sec, Z_max = 20 ft', 'V = 35.4 ft/sec, Z_max = 21 ft', 'V = 37 ft/sec, Z_max = 20.5 ft', 'V = 40 ft/sec, Z_max = 18 ft', 'V = 34 ft/sec, Z_max = 18.5 ft', 'V = 25 ft/sec, Z_max = 23 ft', 'V = 32 ft/sec, Z_max = 22 ft', 'V = 35.4 ft/sec, Z_max = 19.5 ft']\",\"question\":\"A container having an area of 1 ft^2 and a volume of 5 ft^3 holds2 ft^3 of an ideal gas at a pressure of 10 atm. An externalforce is applied to keep the 1440 lb piston in positionin the container, which is open to the atmosphere of 1atm, pressure.When the external force is released the pistonrisesfrictionlesslyup the container. The gas in the containeris always kept at the same temperature. a) What will be the velocity of the piston as itmoves. b) What is the total vertical displacement of thepiston.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}