{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b21f355f-26a4-5dc2-baa0-10aa64560624","task_key":"default--test--4021","task_revision_id":"1","upstream_id":"4021","short_description":"Using Vein der Waal's equation, calculate the pressure exerted by 1 mole of…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['18.79 atm, 1517 atm', '23.79 atm, 2017 atm', '15.79 atm, 1217 atm', '20.79 atm, 1717 atm', '17.79 atm, 1417 atm', '16.79 atm, 1317 atm', '19.79 atm, 1617 atm', '21.79 atm, 1817 atm', '22.79 atm, 1917 atm', '24.79 atm, 2117 atm']\",\"question\":\"Using Vein der Waal's equation, calculate the pressure exerted by 1 mole of carbon dioxide at 0°C in a volume of (a) 1.00 liter,(b) 0.05 liter.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}