{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9257b4a0-d0ed-58e9-b163-fd894f14a4b4","task_key":"default--test--9632","task_revision_id":"1","upstream_id":"9632","short_description":"A string of fixed tension and linear mass density is attached to a vibrating…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The wave speed on the string is fixed.', 'The linear mass density of the string is too low to support standing waves.', 'The string is too short for standing waves to form.', 'The string length is not a multiple of half the wavelength of the wave.', 'The wavelength of the wave produced by the speaker is equal to the speed of waves on the string divided by 60 Hz.', 'The speaker frequency of 60 Hz is too low to produce standing waves.', 'The amplitude of the wave produced by the speaker is too small.', '60 Hz is in the lowest range of audible sound.', 'The string is not properly attached to the speaker.', 'The string tension is too high for standing waves to form.']\",\"question\":\"A string of fixed tension and linear mass density is attached to a vibrating speaker. It is observed that a speaker frequency of 60 Hz does not produce standing waves in the string. Which explanation for this phenomenon is correct?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}