{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"af676769-c6c9-5bb8-a465-c8b573741bbd","task_key":"default--test--12205","task_revision_id":"1","upstream_id":"12205","short_description":"The wings of anaeroplanehave a total plan area of 320 ft^2 The plane weighs…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['0.85, 1937lbf', '0.80, 1987lbf', '0.95, 1837lbf', '0.70, 2087lbf', '0.78, 2032lbf', '1.00, 1787lbf', '0.90, 1887lbf', '0.75, 2037lbf', '0.60, 2187lbf', '0.65, 2137lbf']\",\"question\":\"The wings of anaeroplanehave a total plan area of 320 ft^2 The plane weighs 18,000lbf, and the normal speed in level flightis 230 ft/sec when the atmospheric density is 0.076lbm/ft^3. (a) If thetailplanecontributes 5 percent of thetotal liftforce, whatmust be the lift coefficient of the wings at this operating condition ? (b) If, at the same flight condition, the drag coefficient of the wingsis 0.055, and the total drag is 1.75 times that caused bythe wings alone, what forward thrust is required? Ignore interferencebetween the wings and the fuselage.\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}