{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"978c06df-4922-5618-8dc3-ecc8a044336e","task_key":"all--test--978c06df-4922-5618-8dc3-ecc8a044336e","task_revision_id":"1","upstream_id":"","short_description":"Three days after hospitalization for diabetic ketoacidosis, an 87-year-old woman…","config":"all","split":"test","body":"{\"choices\":\"['Discharge the patient after she has signed an \\\"against medical advice\\\" form', 'Seek a court order to appoint a legal guardian', 'Offer insulin but allow the patient to refuse it', 'Admit to the psychiatric unit']\",\"question\":\"Three days after hospitalization for diabetic ketoacidosis, an 87-year-old woman refuses insulin injections. She says that her medical condition has declined so much that she no longer wishes to go on living; she is nearly blind and will likely require bilateral leg amputations. She reports that she has always been an active person and does not see how her life will be of value anymore. She has no family and most of her friends are sick or deceased. On mental status examination, she is alert and cooperative. She accurately describes her medical history and understands the consequences of refusing insulin. There is no evidence of depression. She dismisses any attempts by the physician to change her mind, saying that the physician is too young to understand her situation. She says, \\\"I know I will die, and this is what I want.\\\" Which of the following is the most appropriate next step in management?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}