{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2b01698-7047-57b1-a2ff-5c0c456c9533","task_key":"default--test--12057","task_revision_id":"1","upstream_id":"12057","short_description":"Carbon dioxide decomposes into carbon monoxide and oxygenby the following…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['\\\\\\\\epsilon = 0.378, x_C_(_O)2= 0.127, x_CO= 0.248, x_(_O)2= 0.025', '\\\\\\\\epsilon = 0.278, x_{CO_2} = 0.527, x_{CO} = 0.148, x_{O_2} = 0.325', '\\\\\\\\epsilon = 0.178, x_{CO_2} = 0.627, x_{CO} = 0.248, x_{O_2} = 0.125', '\\\\\\\\epsilon = 0.578, x_C_(_O)2= 0.327, x_CO= 0.448, x_(_O)2= 0.225', '\\\\\\\\epsilon = 0.678, x_{CO_2} = 0.227, x_{CO} = 0.648, x_{O_2} = 0.125', '\\\\\\\\epsilon = 0.778, x_{CO_2} = 0.127, x_{CO} = 0.748, x_{O_2} = 0.225', '\\\\\\\\epsilon = 0.678, x_C_(_O)2= 0.427, x_CO= 0.548, x_(_O)2= 0.325', '\\\\\\\\epsilon = 0.478, x_C_(_O)2= 0.227, x_CO= 0.348, x_(_O)2= 0.125', '\\\\\\\\epsilon = 0.478, x_{CO_2} = 0.327, x_{CO} = 0.348, x_{O_2} = 0.225', '\\\\\\\\epsilon = 0.878, x_{CO_2} = 0.027, x_{CO} = 0.848, x_{O_2} = 0.425']\",\"question\":\"Carbon dioxide decomposes into carbon monoxide and oxygenby the following reaction: CO_2 \\\\rightleftharpoons CO + (1/2)O_2. Calculate the equilibrium compositions and the extent of reactionat 5301°F and 1 atm. Assume thatK_punder these conditionsis equal to 0.647.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}