{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"71ff2375-efbc-5af8-96b5-12b287c83f01","task_key":"default--test--11825","task_revision_id":"1","upstream_id":"11825","short_description":"A container having a volume of 2.5 ft^3 initially contains oxygen gas at a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['-0.25 lbm', '-0.347 lbm', '-0.347 lbm.mol', '-0.40 lbm', '-0.45 lbm', '-0.35 lbm', '-0.50 lbm', '-0.34 lbm', '-0.30 lbm', '-0.20 lbm']\",\"question\":\"A container having a volume of 2.5 ft^3 initially contains oxygen gas at a pressure of 125 psia and a temperature of 75°F. Oxygen then leaks from the container until the pressure drops to 100 psia, while the temperature remains the same. Assuming ideal gas behavior, determine how many pounds of oxygen leaked out of the container.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}