{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d298f858-2ff5-5b16-83f0-fb683e0958af","task_key":"default--test--4480","task_revision_id":"1","upstream_id":"4480","short_description":"A voltaic cell is made up of a silver electrode in a 1M silver nitrate solution…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['+ 170( Kcal / mole)', '+ 230 (Kcal / mole)', '+ 190( Kcal / mole)', '+ 160 (Kcal / mole)', '+ 180 (Kcal / mole)', '+ 140 (Kcal / mole)', '+ 210 (Kcal / mole)', '+ 200( Kcal / mole)', '+ 150( Kcal / mole)', '+ 220 (Kcal / mole)']\",\"question\":\"A voltaic cell is made up of a silver electrode in a 1M silver nitrate solution and an aluminum electrode in a 1M aluminum nitrate solution. The half reactions are 1) Ag^+ + e^- \\\\rightarrow Ag (s) E° = .80 volt, and (2) Al^3+ +3e^-\\\\rightarrow Al(s) E° = -1.66 volt, calculate the standard free energy change, ∆G°, in Kcal / mole. 1 cal = 4.184 joule 1 F = 96,500 coul, 1 Kcal = 1000 cal.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}