{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f04b1aab-4580-59ee-93e4-191829a46dfb","task_key":"default--test--3976","task_revision_id":"1","upstream_id":"3976","short_description":"1 mole of ammonia at - 33.33°C and 1.00atmis converted to vapor. Calculate q, w…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['q = 1.94 kJ mol^-1, w = 23.33 kJ mol^-1, \\\\\\\\DeltaE = 21.39 kJ mol^-1', 'q = 21.39 kJ mol^-1, w = 23.33 kJ mol^-1, ΔE = -1.94 kJ mol^-1', 'q = 23.33 kJ mol^-1, w = 21.39 kJ mol^-1, ΔE = 44.72 kJ mol^-1', 'q = 1.94 kJ mol^-1, w = -21.39 kJ mol^-1, ΔE = 23.33 kJ mol^-1', 'q = 23.33 kJ mol^-1, w = 1.94 kJ mol^-1, \\\\\\\\DeltaE = 21.39 kJ mol^-1', 'q = 1.94 kJ mol^-1, w = 23.33 kJ mol^-1, ΔE = 25.27 kJ mol^-1', 'q = 589.3 kJ mol^-1, w = 0 kJ mol^-1, ΔE = 589.3 kJ mol^-1', 'q = 21.39 kJ mol^-1, w = 1.94 kJ mol^-1, \\\\\\\\DeltaE = 23.33 kJ mol^-1', 'q = 21.39 kJ mol^-1, w = -1.94 kJ mol^-1, ΔE = 19.45 kJ mol^-1', 'q = 23.33 kJ mol^-1, w = 21.39 kJ mol^-1, \\\\\\\\DeltaE = 1.94 kJ mol^-1']\",\"question\":\"1 mole of ammonia at - 33.33°C and 1.00atmis converted to vapor. Calculate q, w and \\\\DeltaE for the conversion, given that \\\\DeltaH = 589.3 Btu lb^-1. 1 lb of liquid occupies .02345 ft^3 and 1 lb of gas occupies 18.00 ft^3.\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}