{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5acbdc8-a0e7-5838-ac8c-9c39596f7b58","task_key":"default--test--9987","task_revision_id":"1","upstream_id":"9987","short_description":"The wavelengths of the sodium D lines are 589.593 m\\mu and 588.996 m\\mu. (a)…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['987 lines, 1.87 cm', '986 lines, 1.86 cm', '990 lines, 1.90 cm', '989 lines, 1.89 cm', '985 lines, 1.85 cm', '999 lines, 1.99 cm', '984 lines, 1.84 cm', '982 lines, 1.82 cm', '988 lines, 1.88 cm', '1000 lines, 2.00 cm']\",\"question\":\"The wavelengths of the sodium D lines are 589.593 m\\\\mu and 588.996 m\\\\mu. (a) What is the order minimum number of lines a grating must have in order to resolve these lines in the first order spectrum? (b) How large a prism is needed to resolve these lines, if the Rate of change of index with wavelength, at a wavelength of 589 m\\\\mu, is 5.30 × 10^-5 permillimicron?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}