{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c2fd88d-9c99-5ed1-bf26-18bfd6a020df","task_key":"default--test--9152","task_revision_id":"1","upstream_id":"9152","short_description":"In a hologram interference experiment with a helium-neon laser, the surface…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['(a) 7.9 fringes, (b) 0 fringes, (c) 5.6 fringes', '(a) 3.5 fringes, (b) 7.9 fringes, (c) 2.8 fringes', '(a) 0 fringes, (b) 3.5 fringes, (c) 5.6 fringes', '(a) 7.9 fringes, (b) 5.6 fringes, (c) 0 fringes', '(a) 5.6 fringes, (b) 7.9 fringes, (c) 0 fringes', '(a) 3.5 fringes, (b) 2.8 fringes, (c) 0 fringes', '(a) 5.6 fringes, (b) 3.5 fringes, (c) 2.8 fringes', '(a) 0 fringes, (b) 5.6 fringes, (c) 7.9 fringes', '(a) 5.6 fringes, (b) 0 fringes, (c) 3.5 fringes', '(a) 2.8 fringes, (b) 3.5 fringes, (c) 7.9 fringes']\",\"question\":\"In a hologram interference experiment with a helium-neon laser, the surface under test is illuminated and viewed at normal incidence. If the displacement to be determined is 2500 nm, by how many fringes will it be represented if (a) the displacement is normal to the surface, (b) it is 45° to the normal, and (c) it is in the plane of the surface?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}