{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b207ea00-d289-5420-ad77-3f54723d5b41","task_key":"all--test--b207ea00-d289-5420-ad77-3f54723d5b41","task_revision_id":"1","upstream_id":"","short_description":"A patient in a hospital was placed in a wheelchair with his broken leg extended…","config":"all","split":"test","body":"{\"choices\":\"['No, because a jury could find that there was a latent defect in the doors.', 'No, because a jury could find the hospital liable for negligence based on res ipsa loquitur.', 'Yes, because proof of an accident, by itself, does not establish that an injured person was a victim of negligence.', \\\"Yes, because the nurse's action was a superseding cause of the injury. \\\\x80\\\\x83\\\"]\",\"question\":\"A patient in a hospital was placed in a wheelchair with his broken leg extended straight out in front of him. As a nurse employed by the hospital was pushing the wheelchair through a set of automatic doors at a normal pace, the doors closed on the patient's foot, injuring it. The nurse attempted to pull the wheelchair back through the doors. This action caused the doors to close more tightly on the patient's foot, injuring it further. The patient sued the hospital, alleging improper maintenance of the doors. The patient has produced no evidence of specific conduct or neglect on the part of the hospital that would have caused the automatic doors to malfunction. The hospital has moved for summary judgment. Should the court grant the hospital's motion?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}