{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b28f5179-92b3-5616-948b-50f9f32a0e86","task_key":"default--test--9584","task_revision_id":"1","upstream_id":"9584","short_description":"The atomic weight of hydrogen is 1.0082, and of deuterium 2.01445. Compute the…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['\\\\\\\\DeltaƲ_\\\\x07lpha= 6.14 cm- 1, \\\\\\\\DeltaƲ_\\\\x08eta= 7.59 cm- 1, \\\\\\\\Delta\\\\\\\\lambda_\\\\x07lpha= 0.79 A°, \\\\\\\\Delta\\\\\\\\lambda_\\\\x08eta= 0.32 A°', 'Δν_alpha= 1.14 cm^-1, Δν_beta= 2.59 cm^-1, Δλ_alpha= 3.29 Å, Δλ_beta= 2.82 Å', 'Δν_alpha= 7.14 cm^-1, Δν_beta= 8.59 cm^-1, Δλ_alpha= 0.89 Å, Δλ_beta= 0.42 Å', '\\\\\\\\DeltaƲ_\\\\x07lpha= 4.14 cm- 1, \\\\\\\\DeltaƲ_\\\\x08eta= 5.59 cm- 1, \\\\\\\\Delta\\\\\\\\lambda_\\\\x07lpha= 1.79 A°, \\\\\\\\Delta\\\\\\\\lambda_\\\\x08eta= 1.32 A°', '\\\\\\\\DeltaƲ_\\\\x07lpha= 2.14 cm- 1, \\\\\\\\DeltaƲ_\\\\x08eta= 3.59 cm- 1, \\\\\\\\Delta\\\\\\\\lambda_\\\\x07lpha= 2.79 A°, \\\\\\\\Delta\\\\\\\\lambda_\\\\x08eta= 2.32 A°', 'Δν_alpha= 6.54 cm^-1, Δν_beta= 7.99 cm^-1, Δλ_alpha= 0.69 Å, Δλ_beta= 0.52 Å', '\\\\\\\\DeltaƲ_\\\\x07lpha= 5.14 cm- 1, \\\\\\\\DeltaƲ_\\\\x08eta= 6.59 cm- 1, \\\\\\\\Delta\\\\\\\\lambda_\\\\x07lpha= 1.29 A°, \\\\\\\\Delta\\\\\\\\lambda_\\\\x08eta= 1.82 A°', 'Δν_alpha= 5.54 cm^-1, Δν_beta= 6.99 cm^-1, Δλ_alpha= 1.09 Å, Δλ_beta= 1.52 Å', 'Δν_alpha= 4.54 cm^-1, Δν_beta= 5.99 cm^-1, Δλ_alpha= 1.49 Å, Δλ_beta= 1.22 Å', 'Δν_alpha= 3.14 cm^-1, Δν_beta= 4.59 cm^-1, Δλ_alpha= 2.29 Å, Δλ_beta= 1.92 Å']\",\"question\":\"The atomic weight of hydrogen is 1.0082, and of deuterium 2.01445. Compute the separation in wave number and wavelength of the first two lines of the isotopes in theBalmer series.\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}