{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6e9cd23a-3bcb-5bc8-b54b-7536f3b38bf7","task_key":"default--test--9202","task_revision_id":"1","upstream_id":"9202","short_description":"Standing waves are produced by a 100-Hz generator in a string of fixed length.…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The wavelength will be greater, because the tension in the string varies inversely with the wave speed, which varies inversely with the wavelength.', 'Less, because the tension in the string varies directly with the wave speed, which varies directly with the wavelength.', 'The wavelength cannot be determined without more information about the properties of the string and the wave generator.', 'Greater, because the tension in the string varies directly with the wave speed, which varies inversely with the wavelength.', 'Less, because the tension in the string varies directly with the wave speed, which varies inversely with the wavelength.', 'Greater, because the tension in the string varies directly with the wave speed, which varies directly with the wavelength.', 'The wavelength will be less, because the tension in the string varies inversely with the wave speed, which varies directly with the wavelength.', 'The wavelength will be greater, because the increased tension in the string will cause an increase in the wave speed, resulting in a longer wavelength.', 'The wavelength will remain the same, because the tension in the string does not affect the wavelength.', 'The wavelength will be less, because the increased tension in the string will cause a decrease in the wave speed, resulting in a shorter wavelength.']\",\"question\":\"Standing waves are produced by a 100-Hz generator in a string of fixed length. The tension in the string is increased until a new set of standing waves is produced. Will the wavelength of the new standing waves be greater than or less than the wavelength of the original standing waves?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}