{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"35c51c1b-2229-5764-9a6a-91f43b331cd0","task_key":"all--test--35c51c1b-2229-5764-9a6a-91f43b331cd0","task_revision_id":"1","upstream_id":"","short_description":"The same gene that causes various coat patterns in wild and domesticated cats…","config":"all","split":"test","body":"{\"choices\":\"['Evolution is progressive and tends toward a more perfect population.', 'Phenotype is often the result of compromise.', 'Natural selection reduces the frequency of maladaptive genes in populations over the course of time.', 'Polygenic inheritance is generally maladaptive, and should become less common in future generations.']\",\"question\":\"The same gene that causes various coat patterns in wild and domesticated cats also causes the cross-eyed condition in these cats, the cross-eyed condition being slightly maladaptive. In a hypothetical environment, the coat pattern that is associated with crossed eyes is highly adaptive, with the result that both the coat pattern and the cross-eyed condition increase in a feline population over time. Which statement is supported by these observations?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}