{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"11b16a69-1769-5b10-94f9-5b1c4f16253c","task_key":"all--test--11b16a69-1769-5b10-94f9-5b1c4f16253c","task_revision_id":"1","upstream_id":"","short_description":"On which surfaces of the teeth is dental plaque most likely to accumulate in the…","config":"all","split":"test","body":"{\"choices\":\"['The palatal surfaces of the upper molars and lingual surfaces of the lower incisors.', 'The buccal surfaces of the upper molars and lingual surfaces of the lower incisors.', 'The palatal surfaces of the upper molars and labial surfaces of the lower incisors.', 'The buccal surfaces of the upper molars and labial surfaces of the lower incisors.']\",\"question\":\"On which surfaces of the teeth is dental plaque most likely to accumulate in the mouth of a patient with poor oral hygiene?\",\"subject\":\"anatomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}