{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0d6264b-ae94-5f53-929f-69d691a830e7","task_key":"default--test--11902","task_revision_id":"1","upstream_id":"11902","short_description":"IfK_pforH_2(g) + I_2(g) \\rightleftharpoons 2HI(g) at 25°C is 870, then…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['1.000 moles of HI, 0 moles of I2', '0.936 moles of HI, 0.010 moles of I2', '0.750 moles of HI, 0.125 moles of I2', '0.468 moles of HI, 0.010 moles of I2', '0.500 moles of HI, 0.200 moles of I2', '0.936 moles of HI, 0.005 moles of I2', '0.800 moles of HI, 0.100 moles of I2', '0.700 moles of HI, 0.150 moles of I2', '0.468 moles of HI, 0.005 moles of I2', '0.250 moles of HI, 0.250 moles of I2']\",\"question\":\"IfK_pforH_2(g) + I_2(g) \\\\rightleftharpoons 2HI(g) at 25°C is 870, then assumingno solid iodine forms, calculate the number of molesof the following at equilibrium. (a) HI formed when H_2 = 0.5 moles and I_2 = 0.5 moles (b) I_2 formed when H_2 = 0.5 moles and HI = 1.5 moles.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}