{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3296363-e0bd-574e-a586-bf4595e53b7f","task_key":"default--test--4299","task_revision_id":"1","upstream_id":"4299","short_description":"A 2-liter flask maintained at 700°K contains 0.1 mole of CO and a catalyst for…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['0.088 atm^-2, 10.45 atm', '0.086 atm^-2, 10.42 atm', '0.092 atm^-2, 10.50 atm', '0.095 atm^-2, 10.55 atm', '0.082 atm^-2, 10.48 atm', '0.091 atm^-2, 10.60 atm', '0.078 atm^-2, 10.30 atm', '0.080 atm^-2, 10.35 atm', '0.085 atm^-2, 10.40 atm', '0.090 atm^-2, 10.45 atm']\",\"question\":\"A 2-liter flask maintained at 700°K contains 0.1 mole of CO and a catalyst for the reaction CO(g) + 2H_2(g) = CH_3OH(g) Hydrogen is introduced until the equilibrium total pressure is 7atm, at which point 0.06 moles of methanol are formed . (a) CalculateK_pin atm^-2 (b) What would the final pressure be were the same amounts of CO and H_2 used but with no catalyst present so that no reaction occurs?\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}