{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ca79d28f-fa68-5618-a189-c581a15eca13","task_key":"all--test--ca79d28f-fa68-5618-a189-c581a15eca13","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is an example of a cline?","config":"all","split":"test","body":"{\"choices\":\"['The hybrid tomato plant is stronger and produces better fruit than the pure genotype.', 'There are two distinct varieties in one population of snail that inhabits an island in the Pacific Ocean.', 'Males of some species have long antlers to fight other males for females.', 'In one species of rabbit, the ones that evolved in the cold, snowy north are white, while the ones that evolved in the south are brown.']\",\"question\":\"Which of the following is an example of a cline?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}