{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b5e2a9e5-842c-513b-9b05-32a7d9d43460","task_key":"default--test--12144","task_revision_id":"1","upstream_id":"12144","short_description":"A pressure vessel contains an inert gas at a temperature of 140°F and a pressure…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['q = 4610 Btu, \\\\\\\\DeltaE = 3540 Btu, \\\\\\\\DeltaH_v = 3540 Btu', 'q = 3800 Btu, ΔE = 4200 Btu, ΔH_v = 3800 Btu', 'q = 5000 Btu, ΔE = 4000 Btu, ΔH_v = 4500 Btu', 'q = 4610 Btu, \\\\\\\\DeltaE = 4610 Btu, \\\\\\\\DeltaH_v = 3540 Btu', 'q = 3540 Btu, \\\\\\\\DeltaE = 4610 Btu, \\\\\\\\DeltaH_v = 4610 Btu', 'q = 4610 Btu, ΔE = 4610 Btu, ΔH_v = 4610 Btu', 'q = 3000 Btu, ΔE = 3000 Btu, ΔH_v = 3500 Btu', 'q = 4200 Btu, ΔE = 3100 Btu, ΔH_v = 4200 Btu', 'q = 3540 Btu, \\\\\\\\DeltaE = 3540 Btu, \\\\\\\\DeltaH_v = 4610 Btu', 'q = 4000 Btu, ΔE = 3500 Btu, ΔH_v = 4000 Btu']\",\"question\":\"A pressure vessel contains an inert gas at a temperature of 140°F and a pressure of 10 atm. The vessel is then heated until the pressure becomes 20 atm. For one pound mole of the inert gas, calculate a) q, the heat transfer per unit mass, b) \\\\DeltaE, the change in total energy, c) \\\\DeltaH, the change in internal energy.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}