{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f14004e2-5c7f-5281-a105-7ce089ed7f79","task_key":"default--test--9667","task_revision_id":"1","upstream_id":"9667","short_description":"A projector for 1 inch × 1 inch lantern slides uses a projector lamp with a…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['f = + 6\\\", image of a slide would be 50 inches × 50 inches, a complete image, half as bright, would be seen', 'f = + 7\\\", image of a slide would be 40 inches × 40 inches, only half the image would be seen due to obstruction', 'f = + 6\\\", image of a slide would be 50 inches × 50 inches, a complete image, same brightness, would be seen', 'f = + 8\\\", image of a slide would be 30 inches × 30 inches, a complete image, same brightness, would be seen', 'f = + 6.5\\\", image of a slide would be 45 inches × 45 inches, a complete image, less brightness, would be seen', 'f = + 5.5\\\", image of a slide would be 55 inches × 55 inches, a complete image, more brightness, would be seen', 'f = + 7.5\\\", image of a slide would be 35 inches × 35 inches, a complete image, with uneven brightness across the image', 'f = + 7\\\", image of a slide would be 40 inches × 40 inches, a complete image, half as bright, would be seen', 'f = + 4.5\\\", image of a slide would be 70 inches × 70 inches, only a partial image would be seen due to vignetting', 'f = + 5\\\", image of a slide would be 60 inches × 60 inches, a complete image, half as bright, would be seen']\",\"question\":\"A projector for 1 inch × 1 inch lantern slides uses a projector lamp with a circular filament 0.25 inch in diameter. The condensing lens, of focal length 1 inch, forms an image of the filament which just fills a projection lens 1.25 inches in diameter, (a) Find the focal length of the projection lens. (b) How large an image of the slide will the projector produce on a screen located 25.5 ft from the slide? (c) What would be the effect on the image on the screen if half of the projection lens were covered by an opaque card?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}