{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa2a45d1-86c9-5419-a153-35b12a9a462c","task_key":"default--test--10083","task_revision_id":"1","upstream_id":"10083","short_description":"An achromatic prism combination is to be constructed of crown- and flint-glass…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['10 degrees', '7.20 degrees', '4.45 degrees', '3.75 degrees', '2.50 degrees', '5.40 degrees', '9.00 degrees', '8.15 degrees', '6.30 degrees', '11.00 degrees']\",\"question\":\"An achromatic prism combination is to be constructed of crown- and flint-glass components For light of wavelengths 6563 \\\\AA, 5893 \\\\AA, and 4861 \\\\AA, the crown glass has relative indices of refraction of 1.5146, 1.5171, and 1.5233, respectively and the relative indices of refraction of the flint glass are 1.6224, 1.6272, 1.6385, respectively. The wavelengths of 6563 \\\\AA, 5893 \\\\AA, and 4861 \\\\AA, correspond to red, yellow, and blue light, respectively. The crown-glass prism to be used has an angle of 10°. What must be the angle of the flint-glass prism?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}