{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd11ac87-97f8-5bb0-9cc2-4e9f39f4e236","task_key":"default--test--4338","task_revision_id":"1","upstream_id":"4338","short_description":"A solution of a weak base is titrated with a solution of a standard strong acid.…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['Initially, the pH quickly decrease, then there is a gradual decrease to the equivalence point where the pOH equals the pKb of the base.', 'Initially, the pH quickly decreases, then there is a gradual decrease to give a pH equal to 7 at the equivalence point.', 'Initially, the pH slowly increases, then there is a rapid increase to give a pH above 7 at the equivalence point.', 'Initially, the pH slowly decreases, then there is a rapid increase to give a pH equal to 7 at the equivalence point.', 'The pH of the solution gradually decreases throughout the experiment and the pH at the equivalence point is above 7.', 'Initially, the pH slowly decreases, then there is a rapid decrease to give a pH equal to 7 at the equivalence point.', 'The pH of the solution gradually increases throughout the experiment and the pH at the equivalence point is above 7.', 'Initially, the pH slowly decreases, then there is a rapid decrease to give a pH below 7 at the equivalence point.', 'Initially, the pH quickly decrease, then there is a gradual increase to the equivalence point where the pOH equals the pKa of the base.']\",\"question\":\"A solution of a weak base is titrated with a solution of a standard strong acid. The progress of the titration is followed with a pH meter. Which of the following observations would occur?\",\"src\":\"ori_mmlu-high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}