{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"afd76cfa-5ab6-5afc-880f-e823dbcc043b","task_key":"all--test--afd76cfa-5ab6-5afc-880f-e823dbcc043b","task_revision_id":"1","upstream_id":"","short_description":"A driver was having trouble finding a place to park his car near a store at…","config":"all","split":"test","body":"{\"choices\":\"['$5,000, or the full amount of damages to his car.', \\\"$4,000, or the full amount of his damages, minus the woman's damages.\\\", '$2,500, or half of his damages.', 'Nothing, because the driver was contributorily negligent for parking his car so that part of it stuck out into the street.']\",\"question\":\"A driver was having trouble finding a place to park his car near a store at which he needed to make a quick stop to purchase something. He decided to just park along the road next to the store, even though there was not really a lane or space there intended for parking. The driver pulled his car as far off the roadway as he could and figured that it would be fine because he would only be in the store for a few minutes. While the driver was in the store, a car driven by a woman approached the spot where the driver had left his car. When the woman saw the driver's car and realized it was partially obstructing the road, she tried to avoid hitting it but crashed into it. The accident caused $5,000 worth of damage to the driver's car and $1,000 worth of damage to the woman's car. Assume that the jurisdiction follows traditional contributory negligence rules and that the woman had the last clear chance to avoid the collision. How much, if anything, could the driver recover in a lawsuit against the woman for negligence?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}