{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"526d8183-9c5b-5c43-8a82-5d3561068883","task_key":"default--test--9927","task_revision_id":"1","upstream_id":"9927","short_description":"In an experiment designed to study the photoelectric effect, it is observed that…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The metal would start to heat up due to increased light intensity.', 'The light would start producing photoelectrons with a kinetic energy equal to the energy of the incident photons plus the work function of the metal.', 'The light would change color due to increased intensity.', 'The wavelength of the light would decrease due to increased intensity.', 'After several seconds, necessary for the electrons to absorb sufficient energy from the incident light, photoelectrons would be produced with a kinetic energy equal to the energy of the incident photons minus the work function of the metal.', 'Nothing would happen.', 'Almost immediately, photoelectrons would be produced with a kinetic energy equal to the energy of the incident photons.', 'Photoelectrons would be produced with a kinetic energy equal to twice the energy of the incident photons.', 'Almost immediately, photoelectrons would be produced with a kinetic energy equal to the energy of the incident photons minus the work function of the metal.', 'The light would start producing photoelectrons with a kinetic energy less than the energy of the incident photons minus the work function of the metal.']\",\"question\":\"In an experiment designed to study the photoelectric effect, it is observed that low-intensity visible light of wavelength 550 nm produced no photoelectrons. Which of the following best describes what would occur if the intensity of this light were increased dramatically?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}