{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"917045ca-cb84-57b2-97f3-67a5ac80174f","task_key":"all--test--917045ca-cb84-57b2-97f3-67a5ac80174f","task_revision_id":"1","upstream_id":"","short_description":"A 54-year-old woman comes to the office because she has had intermittent…","config":"all","split":"test","body":"{\"choices\":\"['Carbamazepine', 'Lamotrigine', 'Levetiracetam', 'Topiramate']\",\"question\":\"A 54-year-old woman comes to the office because she has had intermittent shooting pain over her right cheek and jaw during the past 3 weeks. Each episode of pain lasts for 1 second or less. The pain is often triggered by cold air, chewing, tactile stimulation, and brushing her teeth. She has had no trauma to the face or head. Medical history is remarkable for tension headaches, obesity, and gastric bypass surgery. She is 165 cm (5 ft 5 in) tall and weighs 62 kg (137 lb); BMI is 23 kg/m2 . Vital signs are normal. The patient cannot tolerate touch over the right side of the face. There is no facial weakness or loss of sensation. The remainder of the physical examination shows no abnormalities. CT scan of the head with and without contrast shows no abnormalities. Which of the following is the most appropriate pharmacotherapy at this time?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}