{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2d275d13-72dd-5da8-bc06-7e31c5a71b5f","task_key":"all--test--2d275d13-72dd-5da8-bc06-7e31c5a71b5f","task_revision_id":"1","upstream_id":"","short_description":"A teacher sets up a reward system for her elementary school students. At the end…","config":"all","split":"test","body":"{\"choices\":\"['Variable ratio schedules create the strongest responses and behavior that is the least susceptible to extinction.', 'The students had more intrinsic motivation to do well on quizzes than to show up on time.', 'The students’ behavior change was stronger in response to a fixed-ratio schedule than it was to a continuous reinforcement schedule.', 'The students’ behavior change was stronger in response to a fixed-ratio schedule than it was to a variable-interval schedule.']\",\"question\":\"A teacher sets up a reward system for her elementary school students. At the end of each day, she gives a sticker to each student who showed up on time that morning. At the end of each week, she gives a sticker to any student who got above a 90% on three quizzes in a row. After months of this regimen, she finds that performance on the quizzes has increased significantly but that tardiness has only decreased slightly. Which of the following best explains the teacher’s observation?\",\"subject\":\"college_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}