{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a2003f87-19e4-5c75-9a28-287c90ebb68d","task_key":"default--test--3617","task_revision_id":"1","upstream_id":"3617","short_description":"Using the following ionic radii, find the fractional void volume in (a)CsCl,…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['0.29 for CsCl, 0.35 for NaCl, 0.21 for LiCl', '0.34 for CsCl, 0.28 for NaCl, 0.26 for LiCl', '0.32 for CsCl, 0.31 for NaCl, 0.22 for LiCl', '0.33 for CsCl, 0.29 for NaCl, 0.27 for LiCl', '0.35 for CsCl, 0.30 for NaCl, 0.25 for LiCl', '0.27 for CsCl, 0.33 for NaCl, 0.22 for LiCl', '0.30 for CsCl, 0.33 for NaCl, 0.20 for LiCl', '0.28 for CsCl, 0.34 for NaCl, 0.24 for LiCl', '0.316 for CsCl, 0.32 for NaCl, 0.23 for LiCl', '0.31 for CsCl, 0.27 for NaCl, 0.25 for LiCl']\",\"question\":\"Using the following ionic radii, find the fractional void volume in (a)CsCl, (b)NaCl, (c)LiCl. Assume that the ions are hard spheres in contact. Ion Radius, \\\\AA Li^+ 0.60 Na^+ 0.95 Cs^+ 1.69 Cl - 1.81 InCsClthe positive ions and the negative ions each comprise a simple cubic lattice. Each ion has eight oppositely charged ions as nearest neighbors. InNaCland LiClthe ions of each sign comprise a face-centered cubic lattice. Each ion has six oppositely charged ions as nearest neighbors.\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}