{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51a649ab-0e6d-541d-9c71-3259cc362895","task_key":"all--test--51a649ab-0e6d-541d-9c71-3259cc362895","task_revision_id":"1","upstream_id":"","short_description":"A football team entered into a 10-year lease with a city for use of the city's…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The court should first hold a jury trial of the team's counterclaim, and then a nonjury trial of the issues remaining in the city's claim.\\\", \\\"The court should first hold a nonjury trial of the city's claim without giving binding effect to its findings or conclusions in the later jury trial of the team's counterclaim.\\\", \\\"The court should first hold a nonjury trial of the city's claim, and then a jury trial of the issues remaining in the team's counterclaim.\\\", \\\"The court should schedule a jury trial of both the city's claim and the team's counterclaim.\\\"]\",\"question\":\"A football team entered into a 10-year lease with a city for use of the city's athletic stadium. Five years into the lease, the team threatened to leave the stadium and move to another city. The city sued the team in federal court, seeking a permanent injunction to prevent the team from breaching its lease and leaving. In its answer, the team included a counterclaim seeking $10 million in damages for losses caused by the city's alleged failure to properly maintain the stadium, as the lease required. The team demanded a jury trial on the counterclaim. The city moved to try its claim for a permanent injunction before the trial on the team's counterclaim. The team objected and moved that the jury trial of its counterclaim be held before the trial of the city's injunction claim. How should the court rule on the parties' motions?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}