{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d06f5419-84b5-58d6-9895-f3abd6054677","task_key":"all--test--d06f5419-84b5-58d6-9895-f3abd6054677","task_revision_id":"1","upstream_id":"","short_description":"Members of two different species possess a similar-looking structure that they…","config":"all","split":"test","body":"{\"choices\":\"['The two species live at great distance from each other.', 'The two species share many proteins in common, and the nucleotide sequences that code for these proteins are almost identical.', 'The sizes of the structures in adult members of both species are similar in size.', 'Both species are well adapted to their particular environments.']\",\"question\":\"Members of two different species possess a similar-looking structure that they use in a similar fashion to perform the same function. Which information would best help distinguish between an explanation based on homology versus one based on convergent evolution?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}