{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f9ed072-c49a-5326-9c0c-b9cd955009ff","task_key":"all--test--6f9ed072-c49a-5326-9c0c-b9cd955009ff","task_revision_id":"1","upstream_id":"","short_description":"A 19-year-old woman who is a regular patient comes to the office for her annual…","config":"all","split":"test","body":"{\"choices\":\"['Androgen-producing ovarian tumor', 'Cushing syndrome', 'Hypothyroidism', 'Polycystic ovarian syndrome']\",\"question\":\"A 19-year-old woman who is a regular patient comes to the office for her annual physical examination and cervical cytology. She tells you that she has not had a menstrual period for the past 6 months. She is a college student who is in good health, has not had any medical illnesses or surgery, and has never been pregnant. She is currently sexually active and uses barrier contraception. She reports that during the past year her menses had become very irregular prior to complete cessation 6 months ago. She also notes that she has gained about 9 kg (20 lb) in the past 6 months and has had an increasing problem with acne and a troublesome growth of hair on her thighs and abdomen. She has been somewhat depressed about this, and her grades have declined. She reports that one of her sisters also had this problem prior to getting married. Physical examination shows a mildly obese young woman who has scattered facial acne, mild male pattern hair growth on the abdomen, and an essentially normal pelvic examination except for slight enlargement of the uterus and both ovaries. This patient's history is most consistent with which of the following?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}