{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09f0f5f7-1f29-5cd8-a25e-b4e82db0a1b7","task_key":"all--test--09f0f5f7-1f29-5cd8-a25e-b4e82db0a1b7","task_revision_id":"1","upstream_id":"","short_description":"An investor from State A filed an action against his State B stockbroker in…","config":"all","split":"test","body":"{\"choices\":\"[\\\"No, because service was made on a person of suitable age found at the stockbroker's place of employment.\\\", 'No, because the stockbroker waived her claim for improper service of process by asserting it in her answer.', \\\"Yes, because an individual defendant may not be served by delivering process to a third party found at the defendant's place of employment.\\\", 'Yes, because the process of State A courts is not effective in State B.']\",\"question\":\"An investor from State A filed an action against his State B stockbroker in federal court in State A. The summons and complaint were served at the stockbroker's office in State B, where the process server handed the documents to the stockbroker's administrative assistant. The stockbroker has answered the complaint, asserting the defense of improper service of process. Assume that both states' requirements for service of process are identical to the requirements of the Federal Rules of Civil Procedure. Is the court likely to dismiss the action for improper service of process?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}