{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"865b45f8-af45-59db-997c-bdb01605035b","task_key":"all--test--865b45f8-af45-59db-997c-bdb01605035b","task_revision_id":"1","upstream_id":"","short_description":"A 42-year-old woman comes to the physician because of an 8-week history of…","config":"all","split":"test","body":"{\"choices\":\"['Abdominal ultrasonography of the right upper quadrant', 'Upper gastrointestinal series with small bowel follow-through', 'CT scan of the abdomen', 'Endoscopic retrograde cholangiopancreatography']\",\"question\":\"A 42-year-old woman comes to the physician because of an 8-week history of intermittent nausea and abdominal pain that occurs 20 to 30 minutes after eating. The pain extends from the epigastrium to the right upper quadrant and is sometimes felt in the right scapula; it lasts about 30 minutes and is not relieved by antacids. The last episode occurred after she ate a hamburger and french fries. She has not had vomiting. She is currently asymptomatic. She is 165 cm (5 ft 5 in) tall and weighs 104 kg (230 lb); BMI is 38 kg/m2 . Examination shows no other abnormalities. Which of the following is the most appropriate next step in management?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}