{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bee311a4-c732-5648-a1e8-26d1166bf452","task_key":"all--test--bee311a4-c732-5648-a1e8-26d1166bf452","task_revision_id":"1","upstream_id":"","short_description":"A motorist was traveling at 5 miles per hour when she became distracted, and…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because in the law of negligence the defendant takes the plaintiff \\\"as he finds her.\\\"', 'No, because the motorist is only liable for foreseeable injuries that are not of psychological origin.', \\\"No, because the victim's psychosomatic reaction is usually held to be malingering under the law.\\\", 'Yes, because the victim in this case is called a \\\"predictably unpredictable plaintiff.\\\"']\",\"question\":\"A motorist was traveling at 5 miles per hour when she became distracted, and negligently tapped the rear of another vehicle. A passenger in the struck vehicle had a rare medical condition that made her highly vulnerable to any slight physical impact or intrusion. The minimal impact caused the passenger to lightly bump her shoulder against the door, which triggered her rare immunosuppressant disease to surface. The passenger became permanently incapacitated from the impact. She sued the negligent motorist for all of her injuries. A physician submitted a report stating that the collision was a substantial factor in causing the disability. Has the plaintiff stated a claim for relief under prevailing legal principles?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}