{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53aadad1-2f4a-50bc-8c03-35839429c961","task_key":"all--test--53aadad1-2f4a-50bc-8c03-35839429c961","task_revision_id":"1","upstream_id":"","short_description":"After the close of the pleadings both plaintiff and defendant duly made motions…","config":"all","split":"test","body":"{\"choices\":\"['Summary judgment can be entered only after all discovery has been completed.', \\\"Motion for summary judgment is the proper motion on the ground that plaintiff's complaint fails to state a cause of action.\\\", 'Since both parties have filed summary judgment motions that assert there are no genuine issues of material fact, summary judgment for plaintiff or defendant will be granted.', \\\"If plaintiff's proofs submitted in support of his motion for summary judgment are not contradicted and if plaintiff's proofs show that no genuine issue of material fact exists, summary judgment will be granted even if defendant's answer denied plaintiff's complaint.\\\"]\",\"question\":\"After the close of the pleadings both plaintiff and defendant duly made motions for summary judgment. Which of the following statements is correct?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}