{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc94bac4-9cb7-5588-9a22-822fc1a04098","task_key":"all--test--dc94bac4-9cb7-5588-9a22-822fc1a04098","task_revision_id":"1","upstream_id":"","short_description":"A solution of a weak base is titrated with a solution of a standard strong acid.…","config":"all","split":"test","body":"{\"choices\":\"['Initially, the pH slowly decreases, then there is a rapid decrease to give a pH below 7 at the equivalence point.', 'The pH of the solution gradually decreases throughout the experiment and the pH at the equivalence point is below 7.', 'Initially, the pH slowly decreases, then there is a rapid decrease to give a pH equal to 7 at the equivalence point.', 'Initially, the pH quickly decrease, then there is a gradual decrease to the equivalence point where the pOH equals the pKb of the base.']\",\"question\":\"A solution of a weak base is titrated with a solution of a standard strong acid. The progress of the titration is followed with a pH meter. Which of the following observations would occur?\",\"subject\":\"high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}