{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c9bc1e67-8dd2-5878-8feb-8a80aa0eb08c","task_key":"default--test--3802","task_revision_id":"1","upstream_id":"3802","short_description":"Glacial acetic acid has a melting point of 16°C at a pressure of 1 atm. a)…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['14.8°C, 11200 cal/mole', '15.8°C, 10700 cal/mole', '15.2°C, 12000 cal/mole', '16.5C, 9500 cal/mole', '14.5°C, 9700 cal/mole', '17.0°C, 9300 cal/mole', '15.5C, 11500 cal/mole', '16.2°C, 10200 cal/mole', '15.0C, 10500 cal/mole', '15.993C, 10900 cal/mole']\",\"question\":\"Glacial acetic acid has a melting point of 16°C at a pressure of 1 atm. a) Calculate the melting point at its vapor pressure of 0atm, given that the acid has a heat of fusion of 2700 cal/mole and a molecular weight of 60. Solid and liquid acetic acid have densities of 1.10 g/cc and 1.05 g/cc respectively, b) Calculate the heat of sublimation of solid acetic acid given that the acid has a normal boiling point of 118°C.\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}