{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae7e5ff9-844f-506e-a675-c598993c0ddb","task_key":"default--test--3598","task_revision_id":"1","upstream_id":"3598","short_description":"A nonvolatile benzoic acid dissolves in ethanol to form an ideal solution.…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['0.45 mole fraction, 0.55atm', '0.60 mole fraction, 0.40 atm', '0.50 mole fraction, 0.50atm', '0.70 mole fraction, 0.30 atm', '0.55 mole fraction, 0.45atm', '0.35 mole fraction, 0.65 atm', '0.40 mole fraction, 0.60atm', '0.75 mole fraction, 0.25 atm', '0.30 mole fraction, 0.70 atm', '0.65 mole fraction, 0.35 atm']\",\"question\":\"A nonvolatile benzoic acid dissolves in ethanol to form an ideal solution. Assuming there is no association or dissociation of the benzoic acid, calculate the solubility of the acid and the vapor pressure of the solution at 80°C given the following data. ∆H, cal/mole Compound Mol. wt M.p ;°C Normalb.p Fusion Vaporization Benzoic acid 122 122 249°C 4,000 12,000 Ethanol 46 -114 80°C 2,000 9,500\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}