{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d5178aaa-98f7-5fdc-b651-28d6a37fd2b6","task_key":"all--test--d5178aaa-98f7-5fdc-b651-28d6a37fd2b6","task_revision_id":"1","upstream_id":"","short_description":"A rooster with gray feathers and a hen with the same phenotype produce 17 gray,…","config":"all","split":"test","body":"{\"choices\":\"['The trait for gray is epistatic over the trait for black.', 'The trait for gray is epistatic over the trait for white.', 'The traits for black and white color demonstrate incomplete dominance.', 'The traits for black and white color demonstrate codominance.']\",\"question\":\"A rooster with gray feathers and a hen with the same phenotype produce 17 gray, 7 black, and 8 white chicks. What is the simplest explanation for the inheritance of these colors in chickens?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}