{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b60c380a-3021-5f60-8eb0-48ce75674b8c","task_key":"all--test--b60c380a-3021-5f60-8eb0-48ce75674b8c","task_revision_id":"1","upstream_id":"","short_description":"A female psychologist provides a 2-month course of brief behavior therapy for a…","config":"all","split":"test","body":"{\"choices\":\"['Ethically because it had been 6 months since termination', 'Probably ethically since there was no coercion involved and the relationship was consensual', 'Unethically, because she engaged in a sexual relationship with a former client, which is prohibited under any circumstances', 'Ethically according to professional standards, but the psychologist exhibited poor professional judgment']\",\"question\":\"A female psychologist provides a 2-month course of brief behavior therapy for a driving phobia to a male client. Six months after termination they meet at an art opening reception and begin to date. Over the next few months, the relationship progresses and they become sexual. In this situation, the psychologist has acted:\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}