{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7a117aed-addc-5072-84d3-d2f5b44962fa","task_key":"default--test--4388","task_revision_id":"1","upstream_id":"4388","short_description":"Chromic oxide (Cr_2 O_3) may be reduced with hydrogen according to the equation…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['0.50 g, 2.5 moles, 1500 lbs', '0.60 g, 3.0 moles, 1600 lbs', '0.30 g, 1.5 moles, 1333 lbs', '0.45 g, 2.25 moles, 1550 lbs', '0.40 g, 2.0 moles, 1400 lbs', '0.10 g, 0.5 moles, 1350 lbs', '0.35 g, 1.75 moles, 1250 lbs', '0.15 g, 0.75 moles, 1300 lbs', '0.20 g, 1.0 moles, 1200 lbs', '0.25 g, 1.25 moles, 1450 lbs']\",\"question\":\"Chromic oxide (Cr_2 O_3) may be reduced with hydrogen according to the equation Cr_2 O_3 + 3H_2 \\\\rightarrow 2Cr + 3H_2 O (a) What weight of hydrogen would be required to reduce 7.6 g of Cr_2 O_3? (b) For each mole of metallic chromium prepared, how many moles of hydrogen will be required? (c) What weight of metallic chromium can be prepared from one ton of Cr_2 O_3? 1 lb = 454 g.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}