{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c04ddfe4-617b-5247-8e95-b3bb13ae82c9","task_key":"all--test--c04ddfe4-617b-5247-8e95-b3bb13ae82c9","task_revision_id":"1","upstream_id":"","short_description":"Three 25.00 mL samples of approximately 0.10 M phenol, C6H5OH, Ka = 1.0 × 10^-10…","config":"all","split":"test","body":"{\"choices\":\"['The indicator was added too late.', 'The wrong indicator was used.', 'There was a base contaminating the unclean beaker.', 'There was an acid contaminating the unclean beaker.']\",\"question\":\"Three 25.00 mL samples of approximately 0.10 M phenol, C6H5OH, Ka = 1.0 × 10^-10 were removed from a container and placed in separate 250 mL beakers. The samples were titrated with standard potassium hydroxide, KOH, solution. Cresol red was the acid-base indicator used in the titration. The samples required 31.75, 32.38, and 41.75 mL to reach the endpoint. Which of the following might explain why one of the samples required significantly more base to reach the endpoint?\",\"subject\":\"high_school_chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}