{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"06606e9a-349b-5d14-951d-e1b54c4b3601","task_key":"all--test--06606e9a-349b-5d14-951d-e1b54c4b3601","task_revision_id":"1","upstream_id":"","short_description":"Which of the following observations helped Darwin shape his concept of descent…","config":"all","split":"test","body":"{\"choices\":\"['Species diversity declines farther from the equator.', 'Fewer species live on islands than on the nearest continents.', \\\"Birds can be found on islands located farther from the mainland than the birds' maximum nonstop flight distance.\\\", 'South American temperate plants are more similar to the tropical plants of South America than to the temperate plants of Europe.']\",\"question\":\"Which of the following observations helped Darwin shape his concept of descent with modification?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}