{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18b30db3-4524-5388-aa80-9eb2d2f372b4","task_key":"all--test--18b30db3-4524-5388-aa80-9eb2d2f372b4","task_revision_id":"1","upstream_id":"","short_description":"Cooper is suing March for money damages. Because he believes portions of March's…","config":"all","split":"test","body":"{\"choices\":\"['Cooper may use the deposition at trial, but, if requested, he must read all parts that in fairness ought to be considered with the part introduced.', \\\"Cooper may use the deposition at trial, but only to contradict or impeach March's prior inconsistent statements or pleadings.\\\", 'Cooper may not use the deposition at trial, as March is able to testify and no exceptional circumstances exist.', 'Cooper may not use the deposition at trial, as this would make March his witness and immune to impeachment.']\",\"question\":\"Cooper is suing March for money damages. Because he believes portions of March's deposition are highly favorable to his case, Cooper's attorney intends to read parts of the deposition at trial instead of calling March to the stand. March objects to Cooper's use of the deposition at trial. What is the court's likely ruling?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}