{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9fc7f673-7a8a-5239-bd4c-afaaef55eb85","task_key":"all--test--9fc7f673-7a8a-5239-bd4c-afaaef55eb85","task_revision_id":"1","upstream_id":"","short_description":"When teaching a patient inhaler technique, how will you ensure that a large…","config":"all","split":"test","body":"{\"choices\":\"['Ask them to take lots of small, quick breaths in before using the inhaler.', 'Ask them to breathe normally when using the inhaler.', 'Ask them to perform the procedure as quickly as they can.', 'Ask them to hold their breath at the end of the inspiration on using the inhaler.']\",\"question\":\"When teaching a patient inhaler technique, how will you ensure that a large proportion of the drug reaches the lower airways?\",\"subject\":\"clinical_knowledge\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}