{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0041cfc8-a0d8-5fd0-b144-3d35628823c5","task_key":"default--test--12143","task_revision_id":"1","upstream_id":"12143","short_description":"Estimate the pressure which would be exerted by 8.2 lb of CO in a 1-ft^3…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['1500psia = 102.0atm, 88.9 atm, 92.4atm', '1000psia = 68.0atm, 58.8 atm, 62.5atm', '850psia = 57.8atm, 50.0 atm, 53.1atm', '1400psia = 95.2atm, 82.3 atm, 85.0atm', '900psia= 60.9atm, 70.5 atm, 75.8atm', '800psia = 54.4atm, 47.6 atm, 50.2atm', '1600psia = 108.9atm, 94.5 atm, 98.6atm', '1200psia= 81.7atm, 68.2 atm, 70.8atm', '1300psia= 88.2atm, 75.6 atm, 80.9atm', '1100psia= 75.1atm, 65.7 atm, 68.5atm']\",\"question\":\"Estimate the pressure which would be exerted by 8.2 lb of CO in a 1-ft^3 container at - 78°F, employing (a) the ideal-gas equation, (b) the vanderWaals equation of state, and (c) theRedlich-Kwongequation.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}