{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e65eb03-38ee-56b8-93c3-2409efaeab76","task_key":"default--test--10086","task_revision_id":"1","upstream_id":"10086","short_description":"A lens is used to project the image of a lantern slide on a screen located 160…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['0.01 inches', '0.25 inches', '1.00 inch', '0.02 inches', '0.40 inches', '0.15 inches', '0.30 inches', '0.10 inches', '0.75 inches', '0.05 inches']\",\"question\":\"A lens is used to project the image of a lantern slide on a screen located 160 ft from the projector. In this position the image on the screen is 100 times larger than the slide. If the screen is moved 100 inches closer, how far must the lantern slide be moved (relative to the lens) to keep the image on the screen in sharp focus?\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}