{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77e042de-711e-5407-83e4-4b090d88e8fc","task_key":"all--test--77e042de-711e-5407-83e4-4b090d88e8fc","task_revision_id":"1","upstream_id":"","short_description":"A school psychologist is asked to help Ms. Smith address problem behaviors that…","config":"all","split":"test","body":"{\"choices\":\"['Developing individual behavior contracts for the 26 students who have received discipline referrals', 'Using comprehensive emotional and behavioral assessments for students who have received discipline referrals', 'Providing school-based group counseling to address issues such as study skills, attendance, decision making, problem solving, and goal setting.', 'Implementing a class-wide behavior management plan, such as a responsecost raffle.']\",\"question\":\"A school psychologist is asked to help Ms. Smith address problem behaviors that are disrupting the learning of her students. The school psychologist is given data that indicate discipline referrals have been written on 26 of the 30 students in Ms. Smith's class. Which of the following is best for the school psychologist to recommend?\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}