{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"707c17dd-abb1-58d4-80e0-1c38d5ec9fbc","task_key":"all--test--707c17dd-abb1-58d4-80e0-1c38d5ec9fbc","task_revision_id":"1","upstream_id":"","short_description":"A university student, a citizen of State A, believes that her university…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Service as required by State B's rules of civil procedure.\\\", \\\"Service by a process server's leaving copies of the summons and complaint with copies of the summons and complaint with secretaries in the respective offices of the athletic director and the university president.\\\", 'Service by emailing copies of the summons and complaint to the athletic director and the university president.', 'Service by the student herself on the athletic director and the university president.']\",\"question\":\"A university student, a citizen of State A, believes that her university violated federal law when it eliminated funding for the women's varsity volleyball team. She has sued the university, a nonprofit corporation located and incorporated in State B, and the university's athletic director, a citizen of State B, in federal court in State B. What is the best method of serving the defendants?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}