{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ce22de87-8b5f-5746-90a3-d64ddaee0028","task_key":"default--test--11292","task_revision_id":"1","upstream_id":"11292","short_description":"Calculate the entropy change for (a) H_2O (s, - 20°C, 1atm) \\rightarrow H_2O (s,…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['0.68eu/mole for (a) and 7.22eu for (b)', '1.27eu/mole for (a) and 7.22eu for (b)', '0.68eu/mole for (a) and 5.27eu for (b)', '1.27eu/mole for (a) and 5.27eu for (b)']\",\"question\":\"Calculate the entropy change for (a) H_2O (s, - 20°C, 1atm) \\\\rightarrow H_2O (s, 0°C, 1atm) (b) H_2O (s, - 20°C, 1atm) \\\\rightarrow H_2O (1, 20°C, 1atm) Assume C_p (H_2O, 1) = 18 cal deg^-1 mole^-1, C_p (H_2O, s) = 9 cal deg^-1 mole^-1 and\\\\DeltaH_fusion= 1440 cal deg^-1 mole^-1, andalso that the heat capacities are independent of temperature.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}