{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69e7acfb-0946-5253-915f-5df3a219edc0","task_key":"all--test--69e7acfb-0946-5253-915f-5df3a219edc0","task_revision_id":"1","upstream_id":"","short_description":"In a meeting with the school psychologist, Ms. Harcar, a new sixth-grade…","config":"all","split":"test","body":"{\"choices\":\"['The study skills of students with disabilities are improved when they are given a single, specific study strategy to follow for all subjects.', 'Students with disabilities often develop study skills on their own and need only some guidance and reinforcement by the teacher.', 'Training in study skills needs to include helping students to guide their own thinking to organize their own study behaviors and to use varied study approaches.', 'Study strategies are best taught in a small group by having students practice collaborative problem-solving activities modeled by the teacher.']\",\"question\":\"In a meeting with the school psychologist, Ms. Harcar, a new sixth-grade teacher, expresses some concerns about a student, Anthony. The school psychologist has worked with the boy and knows him well. Anthony has a mild learning disability and receives academic support. He is doing well on a daily basis but has difficulty performing on tests. The school psychologist discusses ways in which Ms. Harcar could incorporate study-skills training into classroom activities. With regard to study-skills training, the school psychologist should stress which of the following principles while advising Ms. Harcar?\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}