{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7193389-70c9-51bb-8727-b5b109a02907","task_key":"all--test--f7193389-70c9-51bb-8727-b5b109a02907","task_revision_id":"1","upstream_id":"","short_description":"A protester brought an action in federal court against a police officer,…","config":"all","split":"test","body":"{\"choices\":\"['Seek a new trial, because the jury instruction affected the protesterÕs substantial rights.', 'Seek a new trial, because the verdict was against the clear weight of the evidence.', 'Seek judgment as a matter of law, because the jury did not have legally sufficient evidence to find for the officer.', 'Seek judgment as a matter of law, because the juryÕs findings were clearly erroneous.']\",\"question\":\"A protester brought an action in federal court against a police officer, alleging that the officerÕs use of force in arresting the protester violated the protesterÕs federal civil rights. During the jury trial, eyewitnesses gave conflicting testimony on the arrest. At the close of evidence, the protester moved for judgment as a matter of law, which the court denied. The court instructed the jury that the protesterÕs burden of proof was clear and convincing evidence, rather than the correct burden of preponderance of the evidence. The jury returned a verdict for the officer, and the court entered judgment accordingly. What is the protesterÕs best option for challenging the judgment?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}