{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f34768a-a670-5243-bd0e-64ba544ed19d","task_key":"all--test--5f34768a-a670-5243-bd0e-64ba544ed19d","task_revision_id":"1","upstream_id":"","short_description":"A driver had a new car and, as he was carefully driving within the posted speed…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The driver's statement regarding his operation of the car, as well as his statement concerning payment of the hospital bills, are both admissible on the issue of negligence.\\\", \\\"The driver's statement regarding payment of the hospital bills is admissible, but his statement concerning his operation of the car is not admissible.\\\", \\\"The driver's statement regarding his operation of the car is admissible on the issue of negligence, but his statement concerning payment of the hospital bills is not admissible in accordance with public policy considerations.\\\", \\\"Neither the driver's statement regarding his operation of the car nor his statement concerning payment of the hospital bills is admissible on the issue of negligence.\\\"]\",\"question\":\"A driver had a new car and, as he was carefully driving within the posted speed limit, a girl, aged 11, suddenly darted into the street in front of his car. Although\\\\he driver immediately applied his brakes and swerved to avoid the girl, the cat hit the girl, fracturing her legs. As the girl was lying in the street awaiting an ambulance, the driver rushed over to her and said: \\\"Im terribly sorry. This is the first time I ever drove this car. I don't know what happened, but it must have been my fault. Send me all your hospital bills. I'fl pay for everything. \\\"When the girl was later released from the hospital, her parents contacted the driver who refused to pay anything. The driver told the girl's mother, \\\"Since your daughter ran into the street, it was her fault. I have witnesses who saw what she did. If I weren't such a nice guy, I'd sue you for the damage to my new car. \\\"If the girl's parents, on her behalf, sue the driver in tort, which of the following is the most accurate statement regarding the driver's post-accident statements?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}