{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d74cd7d6-6cb7-500f-ad02-e8ae7f313605","task_key":"default--test--3929","task_revision_id":"1","upstream_id":"3929","short_description":"A sulfuric acid solution has a density of 1.8 g/ml and is 90% H_2SO_4 by weight.…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['1260 g, 12.8 M, 25.6 N', '1440 g, 14.4 M, 28.8 N', '900 g, 9.1 M, 18.2 N', '1500 g, 15.0 M, 30.0 N', '1350 g, 13.7 M, 27.4 N', '1080 g, 11.0 M, 22.0 N', '1530 g, 15.5 M, 31.0 N', '1800 g, 18.0 M, 36.0 N', '1980 g, 20.0 M, 40.0 N', '1620 g, 16.5 M, 33.0 N']\",\"question\":\"A sulfuric acid solution has a density of 1.8 g/ml and is 90% H_2SO_4 by weight. What weight of H_2SO_4, is present in 1000 ml of the solution? What is themolarityof the solution? the normality?\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}