{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7864076f-f0ab-5585-9465-bad531cd9251","task_key":"all--test--7864076f-f0ab-5585-9465-bad531cd9251","task_revision_id":"1","upstream_id":"","short_description":"An 18-year-old female presents to the office with a 3-day history of lower…","config":"all","split":"test","body":"{\"choices\":\"['Candida albicans\\\\xa0and\\\\xa0Chlamydia trachomatis', 'Chlamydia trachomatis\\\\xa0and\\\\xa0Neisseria gonorrhoeae', 'Chlamydia trachomatis\\\\xa0and\\\\xa0Treponema pallidum', 'Gardnerella vaginalis\\\\xa0and\\\\xa0Mobiluncus\\\\xa0species']\",\"question\":\"An 18-year-old female presents to the office with a 3-day history of lower abdominal pain and a 2-day history of fever. She reports frequent unprotected sexual intercourse with different partners since she started college 4 months ago. Abdominal examination reveals suprapubic tenderness. Bimanual examination of the uterus reveals more intense tenderness. Swabs of cervical mucus are obtained. This patient should be given antimicrobial chemotherapy to provide treatment for\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}