{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"35e5a485-03ed-5b7a-8b8c-80ff460e673b","task_key":"default--test--6366","task_revision_id":"1","upstream_id":"6366","short_description":"A 54-year-old woman comes to the office because she has had intermittent…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Phenytoin', 'Carbamazepine', 'Topiramate', 'Phenobarbital', 'Valproic acid', 'Pregabalin', 'Gabapentin', 'Levetiracetam', 'Lamotrigine']\",\"question\":\"A 54-year-old woman comes to the office because she has had intermittent shooting pain over her right cheek and jaw during the past 3 weeks. Each episode of pain lasts for 1 second or less. The pain is often triggered by cold air, chewing, tactile stimulation, and brushing her teeth. She has had no trauma to the face or head. Medical history is remarkable for tension headaches, obesity, and gastric bypass surgery. She is 165 cm (5 ft 5 in) tall and weighs 62 kg (137 lb); BMI is 23 kg/m2 . Vital signs are normal. The patient cannot tolerate touch over the right side of the face. There is no facial weakness or loss of sensation. The remainder of the physical examination shows no abnormalities. CT scan of the head with and without contrast shows no abnormalities. Which of the following is the most appropriate pharmacotherapy at this time?\",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}