{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8a24a20c-b742-547d-89d2-7633c3d443c3","task_key":"all--test--8a24a20c-b742-547d-89d2-7633c3d443c3","task_revision_id":"1","upstream_id":"","short_description":"At approximately 3:00 p. m. on December 3, a motorist was speeding down a street…","config":"all","split":"test","body":"{\"choices\":\"[\\\"$50,000, because the motorist's negligence was greater than the pedestrian's.\\\", \\\"$30,000, the proportion of the pedestrian's damages caused by the motorist's negligence, but the payment of $10,000 in hospital expenses will be disregarded under the collateral source rule.\\\", \\\"$20,000, the proportion of the pedestrian's damages caused by her own negligence, but the payment of $10,000 in hospital expenses will be disregarded under the collateral source rule.\\\", \\\"$10,000, the proportion of the pedestrian's damages caused by her own negligence, less the $10,000 in hospital expenses already paid by the insurance company.\\\"]\",\"question\":\"At approximately 3:00 p. m. on December 3, a motorist was speeding down a street at the same time that a pedestrian was crossing the street. When the pedestrian started to cross the street, she saw the traffic light was red. She momentarily stopped, thought about waiting until the light turned green, but then decided to cross anyway. As the pedestrian was halfway across the street, the motorist, who was driving 50 m. p. h. in a 25 m. p. h. zone, struck her with his vehicle. The pedestrian suffered a broken pelvis and internal injuries in the accident. While in the hospital, the pedestrian's insurance company paid $10,000 of her medical expenses. Six months later, the pedestrian brought suit against the motorist to recover damages for all her medical expenses. This jurisdiction has a \\\"modified\\\" comparative negligence statute in effect. Suppose a jury returned a special verdict with the following findings: (1) The motorist was 60 percent negligent in speeding; (2) The pedestrian was 40 percent at fault in crossing the street against the red light; and (3) The pedestrian suffered damages from the accident totaling $50,000. After the verdict, the court was advised that the pedestrian's insurance company had already paid the pedestrian $10,000. As a result, the court should enter a judgment for the pedestrian in the amount of\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}