{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f2c6e19e-17f9-5c6e-a27f-b2acd7dea019","task_key":"all--test--f2c6e19e-17f9-5c6e-a27f-b2acd7dea019","task_revision_id":"1","upstream_id":"","short_description":"A 15-year-old girl comes to the emergency department because, she says,…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Accept the girl's consent as sufficient\\\", 'Obtain a court order permitting evaluation', 'Obtain the written consent of at least two licensed physicians', 'Obtain written consent from at least one of her parents']\",\"question\":\"A 15-year-old girl comes to the emergency department because, she says, \\\"something has been sticking out of my bottom since I had a bowel movement this morning.\\\" She has not had previous episodes, although for more than 1 year she has had occasional difficulty passing stools. She is not in pain but is afraid to move her bowels for fear that the problem will worsen. She tells you that she moved away from home more than a year ago and that her parents contribute nothing to her support. She has a 6-month-old child and lives with a 28-year-old female cousin. She has never been married and does not work or attend school. She has no other symptoms. In order to follow the correct procedure for treating a minor, which of the following is the most appropriate step prior to evaluating this patient's rectal problem?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}