{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1826468-842b-56c5-bff6-c156e4590775","task_key":"all--test--c1826468-842b-56c5-bff6-c156e4590775","task_revision_id":"1","upstream_id":"","short_description":"A couple brings their ten-year-old son to therapy at the suggestion of his…","config":"all","split":"test","body":"{\"choices\":\"['refuse to release the records to anyone but a licensed psychologist.', 'refuse to release the records to anyone but the boy’s parents.', 'release only that information you believe to be relevant to the school’s concerns.', 'release photocopies of your complete file on the boy and his family.']\",\"question\":\"A couple brings their ten-year-old son to therapy at the suggestion of his school counselor who is concerned because the boy has started arguing with his teacher and getting into physical fights with his classmates. After several sessions with the boy and his family, you receive a letter from the school principal requesting information about the boy's condition, and a signed release from the boy's parents is included with the letter. As an ethical psychologist, you should:\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}