{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab416026-26e0-5b94-8aba-c551f837ff28","task_key":"default--test--4369","task_revision_id":"1","upstream_id":"4369","short_description":"(1) Cu(NH_3)^2_4^+ \\rightleftarrows Cu^2+ + 4NH_3k = 1.0 × 10^-12 (2)…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['Ag^+, Co^2+, Co^3+, Cu^2+', 'Cu^2+, Co^2+, Ag^+, Co^3+', 'Co^2+, Ag^+, Cu^2+, Co^3+', 'Co^3+, Co^2+, Ag^+, Cu^2+', 'Ag^+, Cu^2+, Co^2+, Co^3+', 'Cu^2+, Ag^+, Co^3+, Co^2+', 'Co^2+, Cu^2+, Co^3+, Ag^+', 'Cu^2+, Co^3+, Ag^+, Co^2+', 'Co^3+, Ag^+, Cu^2+, Co^2+', 'Ag^+, Co^3+, Cu^2+, Co^2+']\",\"question\":\"(1) Cu(NH_3)^2_4^+ \\\\rightleftarrows Cu^2+ + 4NH_3k = 1.0 × 10^-12 (2) Co(NH_3)^2_6^+ \\\\rightleftarrows Co^2+ + 6NH_3k = 4.0 × 10^-5 (3) Co(NH_3)^3_6^+ \\\\rightleftarrows Co^3+ + 6NH_3k = 6.3 × 10^-36 (4) Ag(NH_3)^+_2 \\\\rightleftarrows Ag^+ + 2NH_3k = 6.0 × 10^-8. Arrange them in order of increasing NH_3 concentration that would be in equilibrium with complex ion, if you start with 1 M of each.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}