{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"641b91c3-f15d-5f03-a74d-f8524c7eaf27","task_key":"all--test--641b91c3-f15d-5f03-a74d-f8524c7eaf27","task_revision_id":"1","upstream_id":"","short_description":"A patient entered the hospital to have a simple appendectomy. She signed a…","config":"all","split":"test","body":"{\"choices\":\"['No, she cannot recover where there is no negligence by the surgeon.', 'Yes, she can claim a lack of informed consent as to the hysterectomy.', 'No, her consent implied that the doctor could perform any other procedures that were necessary.', 'Yes, she can recover on a theory of trespass beyond the bodily parameters.']\",\"question\":\"A patient entered the hospital to have a simple appendectomy. She signed a simple consent form allowing an appendectomy to be performed, and giving the surgeon the right to respond to any life-threatening conditions that required immediate surgical intervention . During surgery, the surgeon performed a full hysterectomy because he felt that it would be a sound medical procedure under the circumstances, even though no emergency existed. The patient sued the surgeon. An expert testified that the surgeon committed no negligence in performing the operation. Does the patient have a valid theory of recovery against the surgeon?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}