{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"49cb2bbb-7d3b-5968-9de1-93cf663e244a","task_key":"all--test--49cb2bbb-7d3b-5968-9de1-93cf663e244a","task_revision_id":"1","upstream_id":"","short_description":"Before the close of evidence in a federal negligence trial, the defendant…","config":"all","split":"test","body":"{\"choices\":\"['No, because the defendant failed to object after the judge gave the instructions to the jury.', 'No, because the defendant failed to object after the judge informed the parties of the instructions she would give.', 'Yes, because the defendant submitted a proposed instruction on contributory negligence.', \\\"Yes, because the judge's failure to give the defendant's contributory negligence instruction amounted to a ruling on the instruction.\\\"]\",\"question\":\"Before the close of evidence in a federal negligence trial, the defendant submitted a proposed jury instruction on contributory negligence. Before instructing the jury, the judge informed the parties of the instructions she would give, which did not include the defendant's contributory negligence instruction or any instruction on contributory negligence. Neither party objected, either then or after the judge had given the instructions. The jury after the judge had given the instructions. The jury returned a verdict for the plaintiff, and the judge entered judgment on the verdict. The defendant would like to appeal the verdict on the ground that the judge should have instructed the jury on contributory negligence. Has the defendant preserved the issue for appeal?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}