{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0a53d3d-842c-5966-8f11-b1ec67b2cb0e","task_key":"all--test--e0a53d3d-842c-5966-8f11-b1ec67b2cb0e","task_revision_id":"1","upstream_id":"","short_description":"Optometrists use a linear scale of lens power, measured in diopters, to…","config":"all","split":"test","body":"{\"choices\":\"['An upright, real image about 20 cm in front of her eyes', 'An upright, virtual image about 20 cm in front of her eyes', 'An inverted, real image about 20 cm behind her eyes', 'An inverted, virtual image 5 cm behind her eyes']\",\"question\":\"Optometrists use a linear scale of lens power, measured in diopters, to prescribe corrective lenses. Sufferers of myopia, or nearsightedness, have difficulty resolving distant objects because the lenses in their eyes are too strong. If a myopic person has a prescription of -5 diopters, what image do her corrective lenses create for distant objects?\",\"subject\":\"high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}