{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c58e8c32-f319-504b-8647-cdf35a77af95","task_key":"all--test--c58e8c32-f319-504b-8647-cdf35a77af95","task_revision_id":"1","upstream_id":"","short_description":"A company that produces facial tissues continually monitors tissue strength. If…","config":"all","split":"test","body":"{\"choices\":\"['Halting the production process when sufficient customer complaints are received.', 'Halting the production process when the tissue strength is below specifications.', 'Halting the production process when the tissue strength is within specifications.', 'Allowing the production process to continue when the tissue strength is below specifications.']\",\"question\":\"A company that produces facial tissues continually monitors tissue strength. If the mean strength from sample data drops below a specified level, the production process is halted and the machinery inspected. Which of the following would result from a Type I error?\",\"subject\":\"high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}