{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f4661c98-e3d3-5d07-980c-1b253dcc7505","task_key":"all--test--f4661c98-e3d3-5d07-980c-1b253dcc7505","task_revision_id":"1","upstream_id":"","short_description":"Unlike large populations, small populations are vulnerable to various processes…","config":"all","split":"test","body":"{\"choices\":\"['Inbreeding and loss of genetic variation threaten a population.', 'Migration of new individuals into the population threatens a population.', 'Mutation reduces the health of a population.', 'Breeding with individuals from a different population may cause the extinction of the first population due to a decrease in diversity.']\",\"question\":\"Unlike large populations, small populations are vulnerable to various processes that draw populations down an extinction vortex toward smaller and smaller populations until no individuals survive. Which of the following statements correctly identifies the factors that endanger a population?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}