{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7e712f31-55a6-514e-b5e6-bcc499a19bfa","task_key":"default--test--11828","task_revision_id":"1","upstream_id":"11828","short_description":"A model of an airplane built scale is to be tested in a wind tunnel which…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['220 km/hr and 1000 kW', '240 km/hr and 950 kW', '275 km/hr and 975 kW', '260 km/hr and 900 kW', '310 km/hr and 890 kW', '320 km/hr and 800 kW', '300 km/hr and 850 kW', '280 km/hr and 1100 kW', '210 km/hr and 1050 kW', '250 km/hr and 938 kW']\",\"question\":\"A model of an airplane built scale is to be tested in a wind tunnel which operates at a pressure of 20 atmospheres. The airplane is expected to fly at a speed of 500 km/h. At what speed should the wind tunnel operate to give dynamic similarity between model and prototype. The drag measured on the model is 337.5 newtons. What power will be needed to propel the aircraft at 500 km/h.\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}