{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5404e041-877c-5d08-a251-74041f5aa2e5","task_key":"default--test--9567","task_revision_id":"1","upstream_id":"9567","short_description":"The distance between a real object and its real image in an infinitely thin lens…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Focal length is 5 inches, object is 7 inches away, image is 25 inches away', 'Focal length is 5.5 inches, object is 13 inches away, image is 19 inches away', 'Focal length is 4.5 inches, object is 12 inches away, image is 20 inches away', 'Focal length is 6 inches, object is 8 inches away, image is 24 inches away', 'Focal length is 3 inches, object is 11 inches away, image is 21 inches away', 'Focal length is 8 inches, object is 6 inches away, image is 26 inches away', 'Focal length is 9 inches, object is 4 inches away, image is 28 inches away', 'Focal length is 10 inches, object is 5 inches away, image is 27 inches away', 'Focal length is 4 inches, object is 9 inches away, image is 23 inches away', 'Focal length is 7 inches, object is 10 inches away, image is 22 inches away']\",\"question\":\"The distance between a real object and its real image in an infinitely thin lens is 32 inches. If the image is 3 times as large as the object find the position and focal length of the lens.\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}