{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4fb518e6-feb3-558f-8cff-06c96f388f47","task_key":"default--test--11754","task_revision_id":"1","upstream_id":"11754","short_description":"A one-fifth scale model of an airplane is tested in (a) a wind tunnel, and (b) a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['600 fps, 40.2 fps', '450 fps, 35.2 fps', '550 fps, 38.2 fps', '480 fps, 32.2 fps', '400 fps, 30.2 fps', '520 fps, 36.2 fps', '470 fps, 31.2 fps', '430 fps, 28.2 fps', '500 fps, 34.2 fps', '510 fps, 33.2 fps']\",\"question\":\"A one-fifth scale model of an airplane is tested in (a) a wind tunnel, and (b) a water tunnel. Calculate the tunnel speeds required to correspond to a full-scale speed of 100 fps at sea level. TABLE 1 Liquid Sp gr \\\\mu × 10^5 lb-sec/ft^2 Alcohol 0.8 2.4 Benzine 0.88 1.36 Gasoline 0.8 0.63 Glycerine 1.3 1,800 Linseed oil 0.95 90 Mercury 13.55 3.24 Olive oil 0.9 175 Turpentine 0.85 3.11 Water, fresh 1.0 2.09 Water, sea 1.03 3.2 TABLE 2 Gas \\\\rho, slug/ft^3 \\\\mu × 10^5 lb-sec/ft^2 Air 0.00238 0.0378 Carbon dioxide 0.00363 0.0305 Hydrogen 0.000166 0.0184 Nitrogen 0.00229 0.0363 Oxygen 0.00262 0.0417\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}