{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3a1c690-3371-5d71-8487-9209843760ce","task_key":"default--test--3698","task_revision_id":"1","upstream_id":"3698","short_description":"At 25°C, the vapor pressure of water is increased from 30 to 31 mm Hg against an…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['0.904 moles of NaCl, 10 atm', '0.950 moles of NaCl, 12 atm', '1.022 moles of NaCl, 8 atm', '0.800 moles of NaCl, 16 atm', '0.850 moles of NaCl, 13 atm', '0.890 moles of NaCl, 15 atm', '1.100 moles of NaCl, 11 atm', '1.050 moles of NaCl, 7 atm', '0.970 moles of NaCl, 14 atm', '0.750 moles of NaCl, 9 atm']\",\"question\":\"At 25°C, the vapor pressure of water is increased from 30 to 31 mm Hg against an external pressure of 10 atm. If the vapor pressure is to be maintained at 30 mm Hg for 1 liter (55.5moles) of water at 25°C and 10atmpressure, a) How muchNaClis to be added to the water? b) What is the osmotic pressure of this solution ifNaClforms an ideal solution with the water?\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}