{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"88936aa5-006d-5a05-b66a-7046ee2d624c","task_key":"all--test--88936aa5-006d-5a05-b66a-7046ee2d624c","task_revision_id":"1","upstream_id":"","short_description":"A plaintiff sued a defendant in federal court for injuries arising out of an…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Move for a new trial or in the alternative for remittitur to reduce the award in light of the shortened duration of the plaintiff's injuries.\\\", \\\"Move for relief from the judgment on the ground that the judgment was based on the jury's mistaken belief that the plaintiff's injuries would be permanent.\\\", 'Move for relief from the judgment on the ground that the plaintiff committed a fraud in obtaining damages for permanent injuries.', \\\"Move for relief from the judgment on the ground that there is newly discovered evidence that the plaintiff's injuries were not permanent.\\\"]\",\"question\":\"A plaintiff sued a defendant in federal court for injuries arising out of an accident involving the parties. The plaintiff alleged and presented evidence at trial demonstrating that her injuries had left her legs permanently paralyzed. The jury found in favor of the plaintiff and awarded her $5 million in damages. Two months after the court entered judgment, the defendant was given a videotape made that day showing the plaintiff jogging with her doctor. What is the best way for the defendant to seek relief from the judgment?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}