{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"11abdece-4e5f-510f-83a5-8ecd3696e10b","task_key":"default--test--11599","task_revision_id":"1","upstream_id":"11599","short_description":"A parachutist weighs 175 lb and has a projected frontal area of2 ft^2 in free…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['200 fps', '220 fps', '325 fps', '250 fps', '307 fps', '400 fps', '275 fps', '350 fps', '450 fps', '365 fps']\",\"question\":\"A parachutist weighs 175 lb and has a projected frontal area of2 ft^2 in free fall. His drag coefficient based on frontal area isfound to be 0.80. If the air temperature is 70°F, determine histerminal velocity. Density of Air Versus Temperature Temperature, °F \\\\rho,lbm/ft^3 \\\\rho, slugs/ft^3 × 10^3 0 0.0862 2.68 10 0.0846 2.63 20 0.0827 2.57 30 0.0811 2.52 40 0.0795 2.47 50 0.0780 2.42 60 0.0764 2.37 70 0.0750 2.33 80 0.0736 2.28 90 0.0722 2.24 100 0.0709 2.20 120 0.0685 2.13 140 0.0663 2.06 150 0.0651 2.02 200 0.0602 1.87 300 0.0523 1.63 400 0.0462 1.44 500 0.0414 1.29 Pressure 14.696lbf/in.^2.\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}