{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fe7a3d19-fbd6-5f23-b257-a6368d7545f4","task_key":"all--test--fe7a3d19-fbd6-5f23-b257-a6368d7545f4","task_revision_id":"1","upstream_id":"","short_description":"A mother took her five-year-old child to a hospital emergency room for…","config":"all","split":"test","body":"{\"choices\":\"['No, because the mother was contributorily negligent in leaving the child alone with the doctor during treatment.', \\\"No, because the mother was neither the direct victim of the doctor's conduct nor a contemporaneous witness.\\\", \\\"Yes, because the doctor's conduct was outrageous.\\\", \\\"Yes, because the mother's distress was the natural and foreseeable consequence of the doctor's conduct. \\\\x80\\\\x83\\\"]\",\"question\":\"A mother took her five-year-old child to a hospital emergency room for treatment. A doctor on the hospital staff molested the child while treating her. At the time, no one was in the treatment room except the doctor and the child; the mother had left the room to get a cup of coffee. Two weeks later, when the child told her mother what had occurred in the treatment room, the mother suffered severe emotional distress that caused her to become physically ill. In an action against the doctor by the mother on her own behalf to recover for intentional infliction of emotional distress, is the mother likely to prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}