{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8f614b7b-d782-5750-854a-6c88a84b774f","task_key":"all--test--8f614b7b-d782-5750-854a-6c88a84b774f","task_revision_id":"1","upstream_id":"","short_description":"A driver of a car negligently hit a pedestrian. The pedestrian had an open wound…","config":"all","split":"test","body":"{\"choices\":\"['All damages for wrongful death because it is foreseeable that this kind of negligence could injure someone who will not accept treatment for religious reasons.', \\\"No damages, because the pedestrian's wrongdoing in not accepting treatment was the sole cause for her death.\\\", 'Damages for the wound and the pain and suffering up to the point that she refused the transfusion.', \\\"No damages, because the pedestrian's refusal of treatment constitutes contributory negligence.\\\"]\",\"question\":\"A driver of a car negligently hit a pedestrian. The pedestrian had an open wound and was rushed to the hospital for a blood transfusion. At the hospital she refused the transfusion because of religious beliefs. She died shortly thereafter. The physician verified that the patient would have fully recovered if she had agreed to treatment. What damages can the pedestrian's estate collect from the driver of the car?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}