{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dbe5f4be-8c04-5e52-adbd-17abdf10dacc","task_key":"all--test--dbe5f4be-8c04-5e52-adbd-17abdf10dacc","task_revision_id":"1","upstream_id":"","short_description":"A man who was emotionally upset due to marital problems voluntarily checked into…","config":"all","split":"test","body":"{\"choices\":\"['No, because the hospital is strictly liable for releasing patients who it knows or should know represent an unreasonable danger to third persons.', 'No, because the special relationship and the control between doctor and an in-patient mandates due care by the doctor to prevent a foreseeable danger to others.', 'Yes, because there is no duty to control the conduct of another person to prevent that person from harming others.', 'Yes, because the intervening acts of third parties are unforeseeable and cannot give rise to liability.']\",\"question\":\"A man who was emotionally upset due to marital problems voluntarily checked into a private medical facility for treatment. State law provided that if he tried to leave against medical advice, the hospital could hold him for 72 hours while trying to convince him to stay. During the stay, he told his medical providers that he was intensely angry at his wife, who was living with another man, and he wanted to harm her. Despite that knowledge, the hospital issued him an unrestricted weekend pass. When he got out he shot and killed his wife. The man's children sued the hospital for negligence. The hospital filed a motion to dismiss mainly because there was no privity with the decedent and no duty owed to her. Will the court grant the motion to dismiss?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}