{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f74402f0-cd1f-5701-8060-2c8d7026a4f6","task_key":"all--test--f74402f0-cd1f-5701-8060-2c8d7026a4f6","task_revision_id":"1","upstream_id":"","short_description":"When consulting with a colleague about a “therapeutic impasse” you are having…","config":"all","split":"test","body":"{\"choices\":\"['it is always necessary to advise the client about the consultation.', 'it is necessary to get a signed waiver of confidentiality from the client before discussing confidential information with the consultant.', 'it is unnecessary to advise the client of the consultation as long as only information that is relevant to the impasse is discussed.', \\\"it is unnecessary to advise the client of the consultation as long as the client's identity is not revealed.\\\"]\",\"question\":\"When consulting with a colleague about a “therapeutic impasse” you are having with a therapy client:\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}