{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"abec748d-d7f5-5987-8801-0e820e91e954","task_key":"all--test--abec748d-d7f5-5987-8801-0e820e91e954","task_revision_id":"1","upstream_id":"","short_description":"A state has a hit-and-run statute in effect that makes it a crime to leave the…","config":"all","split":"test","body":"{\"choices\":\"['guilty, because she unlawfully fled the scene of an accident in violation of her statutory duty.', \\\"guilty, because her failure to render aid to the victim would make the defendant criminally responsible for the victim's death.\\\", \\\"not guilty, because under the circumstances her failure to aid the victim cannot be a basis for imposing criminal responsibility for the victim's death.\\\", \\\"not guilty, because there was not a sufficient causal connection between her actions and the victim's death to impose criminal responsibility.\\\"]\",\"question\":\"A state has a hit-and-run statute in effect that makes it a crime to leave the scene of an accident. One afternoon, a 9-year-old victim was riding her bicycle along the street. As the victim swerved into the southbound lane, her bicycle was struck by a car driven by the defendant. The victim was knocked off her bike and thrown onto the sidewalk adjacent to the street. Although the victim received some minor scrapes and bruises, she was not seriously injured. Following the accident, the car driven by the defendant sped away. Moments later, however, a tractor-trailer crashed into the rear of a car about 30 feet from where the victim was lying. The car almost instantly caught fire as its gas tank exploded. The victim, who was engulfed in the flaming wreckage, was killed. If the defendant is charged with involuntary manslaughter for the death of the victim, the defendant should be found\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}