{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fce79619-85cf-5441-aecd-2a703d6c51be","task_key":"all--test--fce79619-85cf-5441-aecd-2a703d6c51be","task_revision_id":"1","upstream_id":"","short_description":"Which of the following best summarizes a view of classical behaviorism?","config":"all","split":"test","body":"{\"choices\":\"['Behavior is under the control of external stimuli that either reinforce or punish actions, thereby affecting the likelihood of the occurrence of these behaviors.', 'Behavior can be controlled by introspection.', \\\"Behavior is the result of competing motives that result from mental events that occur outside of one's awareness.\\\", 'Behavior is influenced by internal drives and motivation.']\",\"question\":\"Which of the following best summarizes a view of classical behaviorism?\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}