{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae1f07b3-d489-5a0c-9b2c-e2a4d0cedf53","task_key":"default--test--11673","task_revision_id":"1","upstream_id":"11673","short_description":"An aircraft is flying in level flight at a speed of 250 km/hr throughair at…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['7.10m2', '7.03m2', '7.20 m²', '6.80m2', '8.00 m²', '5.50 m²', '6.30 m²', '6.60 m²', '6.95m2', '7.50 m²']\",\"question\":\"An aircraft is flying in level flight at a speed of 250 km/hr throughair at standard conditions. The lift coefficient at this speedis 0.4 and the drag coefficient is 0.0065. The mass of theaircraft is 850 kg. Calculate the effective lift area for the craft.\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}