{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"01dc99f5-1a50-5c1a-884c-f6ed9105a2ad","task_key":"default--test--11749","task_revision_id":"1","upstream_id":"11749","short_description":"A mixture of 4lbmof CO_2 and 3lbmof N_2 is stored in a tank with a volume of 5…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['P(total) = 215psia, x(CO_2) = 0.46, x(N_2) = 0.54, M(mixture) = 33lbm/1b - mole, R = 42.5 (ft - lb) / (lbm-°R)', 'P(total) = 245psia, x(CO_2) = 0.44, x(N_2) = 0.56, M(mixture) = 39lbm/1b - mole, R = 47 (ft - lb) / (lbm-°R)', 'P(total) = 230psia, x(CO_2) = 0.45, x(N_2) = 0.55, M(mixture) = 36lbm/1b - mole, R = 44 (ft - lb) / (lbm-°R)', 'P(total) = 240psia, x(CO_2) = 0.5, x(N_2) = 0.5, M(mixture) = 38lbm/1b - mole, R = 46 (ft - lb) / (lbm-°R)', 'P(total) = 200psia, x(CO_2) = 0.5, x(N_2) = 0.5, M(mixture) = 30lbm/1b - mole, R = 40 (ft - lb) / (lbm-°R)', 'P(total) = 235psia, x(CO_2) = 0.47, x(N_2) = 0.53, M(mixture) = 37lbm/1b - mole, R = 44.5 (ft - lb) / (lbm-°R)', 'P(total) = 210psia, x(CO_2) = 0.48, x(N_2) = 0.52, M(mixture) = 32lbm/1b - mole, R = 41 (ft - lb) / (lbm-°R)', 'P(total) = 229.49psia, x(CO_2) = 0.459, x(N_2) = 0.541, M(mixture) = 35.35lbm/1b - mole, R = 43.7 (ft - lb) / (lbm-°R)', 'P(total) = 220psia, x(CO_2) = 0.42, x(N_2) = 0.58, M(mixture) = 34lbm/1b - mole, R = 42 (ft - lb) / (lbm-°R)', 'P(total) = 250psia, x(CO_2) = 0.4, x(N_2) = 0.6, M(mixture) = 40lbm/1b - mole, R = 45 (ft - lb) / (lbm-°R)']\",\"question\":\"A mixture of 4lbmof CO_2 and 3lbmof N_2 is stored in a tank with a volume of 5 ft^3. The temperature of the mixture is maintained at 80°F. Evaluate (a) the total pressure of the mixture, (b) the mole fraction of both the gases, (c) the molecular weight of the mixture, and (d) the apparent specific gas constant of the mixture.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}