{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d7c7c08f-e1cc-5561-b767-22808745001c","task_key":"all--test--d7c7c08f-e1cc-5561-b767-22808745001c","task_revision_id":"1","upstream_id":"","short_description":"Two days before his home was to be sold at a foreclosure sale, a homeowner…","config":"all","split":"test","body":"{\"choices\":\"['No, because a TRO is immediately appealable.', 'No, because the 30-day extension makes the TRO equivalent to a preliminary injunction and therefore appealable.', 'Yes, because a TRO is not appealable under the interlocutory appeals statute.', 'Yes, because there is no final judgment from which an appeal may be taken.']\",\"question\":\"Two days before his home was to be sold at a foreclosure sale, a homeowner obtained a temporary restraining order (TRO) in federal court that prevented his lender from proceeding with the sale for 14 days or until a preliminary injunction hearing could take place, whichever was sooner. When a preliminary injunction hearing could not be scheduled within the original 14-day period, the court extended the TRO for another 30 days. The lender appealed the court's order extending the TRO. The homeowner has moved to dismiss the appeal. Is the appellate court likely to dismiss the appeal?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}