{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da8124d2-b84b-5273-a406-4ff6ac178245","task_key":"default--test--9242","task_revision_id":"1","upstream_id":"9242","short_description":"Using the refractive indices listed below consider a plano-convex lens made of…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['27.9 cm and 28.8 cm', '24.0 cm and 25.0 cm', '26.5 cm and 27.6 cm', '26.2 cm and 27.1 cm', '25.8 cm and 26.9 cm', '32.0 cm and 33.1 cm', '30.1 cm and 31.2 cm', '28.5 cm and 29.4 cm', '23.3 cm and 24.4 cm', '29.2 cm and 30.3 cm']\",\"question\":\"Using the refractive indices listed below consider a plano-convex lens made of flint glass and having a radius of curvature of + 20 cm. Find the focal lengths of the lens for blue and red light. Fraunhofer line Color Wavelength (nm) Refractive Crown Index Flint F Blue 486.1 1.52225 1.71748 D Yellow 589.6 1.51666 1.70100 C Red 656.3 1.51418 1.69427\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}