{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"94e7f82d-6eda-5485-9a5c-704cc71223e3","task_key":"default--test--9984","task_revision_id":"1","upstream_id":"9984","short_description":"A point light source is on the axis of a convergent lens, and an image is formed…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['66.67 cm', '40 cm', '- 40 cm', '50 cm', '- 16.67 cm', '- 100 cm', '- 50 cm', '25 cm', '- 66.67 cm', '- 25 cm']\",\"question\":\"A point light source is on the axis of a convergent lens, and an image is formed 25 cm from the lens on the other side. When a second lens is placed in contact with the first, the image is formed 40 cm from the combination on the side opposite the source. What is the focal length of the second lens?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}