{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"3bb30b3a-a507-56c1-bebd-c9acfdedf763","task_key":"all--test--3bb30b3a-a507-56c1-bebd-c9acfdedf763","task_revision_id":"1","upstream_id":"","short_description":"The walls of the maxillary sinus are sinus is related to","config":"all","split":"test","body":"{\"choices\":\"['the floor of the orbit.', 'the floor of the orbit and the upper posterior teeth.', 'the floor of the orbit, the upper posterior teeth and the infratemporal fossa.', 'the floor of the orbit, the upper posterior teeth, the infratemporal fossa and the hard palate.']\",\"question\":\"The walls of the maxillary sinus are sinus is related to\",\"subject\":\"anatomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}