{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f8b9de41-3576-5b2d-9145-d15adf80bec3","task_key":"all--test--f8b9de41-3576-5b2d-9145-d15adf80bec3","task_revision_id":"1","upstream_id":"","short_description":"An inexperienced bicycle rider took her new bike for a test run. At an…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because the driver had the last clear chance to avoid the accident, which abrogates the comparative negligence law.', 'Yes, because negligence per se is a final judgment of total negligence against the driver and it cannot be modified or rebutted.', \\\"No, because the common law doctrine of negligence per se does not abrogate the defendant's right to apportion fault under the comparative negligence statute.\\\", 'No, because she entered the intersection knowing it was a red light, thereby putting herself voluntarily and knowingly in danger, and she assumed the risk.']\",\"question\":\"An inexperienced bicycle rider took her new bike for a test run. At an intersection, she could not stop for a red light and went into the intersection, where she slipped off the bike. While attempting to remount it, a car coming into the intersection with a green light ran her over, causing severe injuries. The car driver was distracted by his cell phone and received a careless driving ticket from the police. The woman filed a claim for damages, asserting that the car driver was negligent per se. She claimed that a finding of negligence per se prevented the driver from asserting comparative negligence under a state statute. Will the trial court likely grant the woman's motion to preclude the man's attempted comparative negligence defense?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}