{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d9cd9b9-3a39-5336-9462-0a7e57722387","task_key":"all--test--5d9cd9b9-3a39-5336-9462-0a7e57722387","task_revision_id":"1","upstream_id":"","short_description":"A string of fixed tension and linear mass density is attached to a vibrating…","config":"all","split":"test","body":"{\"choices\":\"['The string length is not a multiple of half the wavelength of the wave.', 'The wave speed on the string is fixed.', '60 Hz is in the lowest range of audible sound.', 'The wavelength of the wave produced by the speaker is equal to the speed of waves on the string divided by 60 Hz.']\",\"question\":\"A string of fixed tension and linear mass density is attached to a vibrating speaker. It is observed that a speaker frequency of 60 Hz does not produce standing waves in the string. Which explanation for this phenomenon is correct?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}