{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0578dd3d-8a54-55b1-99e4-b724e2b67f1f","task_key":"all--test--0578dd3d-8a54-55b1-99e4-b724e2b67f1f","task_revision_id":"1","upstream_id":"","short_description":"A motorcyclist was involved in a collision with a truck. The motorcyclist sued…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Claim preclusion (res judicata) bars the motorcyclist's action against the company.\\\", \\\"Issue preclusion (collateral estoppel) establishes the company's lack of negligence.\\\", 'The motorcyclist violated the doctrine of election of remedies.', 'The state-court judgment is the law of the case.']\",\"question\":\"A motorcyclist was involved in a collision with a truck. The motorcyclist sued the truck driver in state court for damage to the motorcycle. The jury returned a verdict for the truck driver, and the court entered judgment. The motorcyclist then sued the company that employed the driver and owned the truck in federal court for personal-injury damages, and the company moved to dismiss based on the state-court judgment. If the court grants the company's motion, what is the likely explanation?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}