{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"545bc641-dac5-5d89-a58e-2e0757f9be99","task_key":"default--test--3880","task_revision_id":"1","upstream_id":"3880","short_description":"At 760torr, 100 grains of benzene is vaporized at its boiling At 760torr, 100…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['W_rev= - 898 cal, q = 9440 cal, \\\\\\\\DeltaH = 9440 cal, \\\\\\\\DeltaE = 8542 cal', 'W_rev= - 700 cal, q = 9400 cal, \\\\\\\\DeltaH = 9400 cal, \\\\\\\\DeltaE = 8500 cal', 'W_rev= - 880 cal, q = 9300 cal, ΔH = 9300 cal, ΔE = 8500 cal', 'W_rev= - 850 cal, q = 9440 cal, ΔH = 9440 cal, ΔE = 8600 cal', 'W_rev= - 900 cal, q = 9500 cal, \\\\\\\\DeltaH = 9500 cal, \\\\\\\\DeltaE = 8600 cal', 'W_rev= - 850 cal, q = 9400 cal, ΔH = 9500 cal, ΔE = 8700 cal', 'W_rev= - 898 cal, q = 9500 cal, ΔH = 9300 cal, ΔE = 8400 cal', 'W_rev= - 800 cal, q = 9300 cal, \\\\\\\\DeltaH = 9300 cal, \\\\\\\\DeltaE = 8400 cal', 'W_rev= - 900 cal, q = 9400 cal, ΔH = 9400 cal, ΔE = 8600 cal', 'W_rev= - 920 cal, q = 9440 cal, ΔH = 9500 cal, ΔE = 8600 cal']\",\"question\":\"At 760torr, 100 grains of benzene is vaporized at its boiling At 760torr, 100 grains of benzene is vaporized at its boiling point of 80.2°C. Calculate a)W_rev, b) q, c) \\\\DeltaH, d) \\\\DeltaE. The c) \\\\DeltaH, d) \\\\DeltaE. The heat of vaporization is 94.4 (cal / g).\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}