{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3af650e4-cc40-56fb-a6d9-84d23db68c66","task_key":"all--test--3af650e4-cc40-56fb-a6d9-84d23db68c66","task_revision_id":"1","upstream_id":"","short_description":"A 50-year-old nurse who had been fired from his job at ahospital told his…","config":"all","split":"test","body":"{\"choices\":\"['No, because sanctions are not proper against the attorney of a represented party.', 'No, because the hospital failed to give the attorney the chance to withdraw the complaint in advance of filing the motion with the court.', 'Yes, because the nurseÕs attorney failed to conduct areasonable pre-filing inquiry.', 'Yes, because the nurseÕs complaint contained legal contentions that were not warranted by existing lawbased on the facts in this case.']\",\"question\":\"A 50-year-old nurse who had been fired from his job at ahospital told his attorney, ÒI was fired because of my age, and I want to sue the hospital.Ó Based on this information, the attorney filed an age discrimination complaint against the hospital in federal court. As it turned out, the hospital had hired a 52-year-old man as the nurseÕs replacement, a fact that rendered an age discrimination claim unavailable. The hospital responded tothe complaint by filing a motion for sanctions against thenurseÕs attorney. Is the court likely to grant the hospitalÕs motion?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}