{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"46c7860c-f01b-5018-b71a-984946ccbf85","task_key":"all--test--46c7860c-f01b-5018-b71a-984946ccbf85","task_revision_id":"1","upstream_id":"","short_description":"A 10-year-old boy is brought for a follow-up examination 2 days after he was…","config":"all","split":"test","body":"{\"choices\":\"['Avoid areas known to have bees', 'Avoid wearing colorful clothing outside', 'Carrying diphenhydramine tablets', 'Carrying self-injectable epinephrine']\",\"question\":\"A 10-year-old boy is brought for a follow-up examination 2 days after he was seen in the emergency department because of hives, hoarseness, and light-headedness. His symptoms began 15 minutes after he was stung by a bee and lasted approximately 60 minutes; they resolved before he was treated. He has been stung by bees three times over the past year, and each reaction has been more severe. Examination shows no abnormalities. Which of the following is the most appropriate recommendation to prevent future morbidity and mortality from this condition?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}