{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98417fa8-43ee-5032-93f4-63f8550a63cb","task_key":"default--test--4130","task_revision_id":"1","upstream_id":"4130","short_description":"K_dissof water for 2H_2O \\rightleftarrows H_3O^+ + OH^- changes from 1.0 ×…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['Neutrality changes, with water becoming more basic, while pH remains constant', 'Only pH changes, but the value increases', 'pH decreases slightly, while neutrality remains the same', 'Neither pH nor neutrality change', \\\"pH doesn't change, neutrality changes\\\", 'Only neutrality changes, but the water becomes more acidic', \\\"pH changes, neutrality doesn't\\\", 'Both pH and neutrality change, with water becoming more acidic', 'Both pH and neutrality change', 'Both pH and neutrality remain constant, but the concentration of H_3O^+ increases']\",\"question\":\"K_dissof water for 2H_2O \\\\rightleftarrows H_3O^+ + OH^- changes from 1.0 × 10^-14 at 25°C to 9.62 × 10^-14 at 60°C. Does the pH of water or its neutrality change when the temperature is increased from 25°C to 60°C?\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}