{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ddde7e0-f1e8-5b5f-9c48-e37e2b6d893e","task_key":"all--test--5ddde7e0-f1e8-5b5f-9c48-e37e2b6d893e","task_revision_id":"1","upstream_id":"","short_description":"Stomata allow gases, such as H2O and CO2, to exchange between the inside of a…","config":"all","split":"test","body":"{\"choices\":\"['H2O diffuses out of the leaf faster than CO2 enters.', 'H2O diffuses out of the leaf slower than CO2 enters.', 'CO2 diffuses out of the leaf faster than H2O enters.', 'H2O exchanges with CO2 at equal rates.']\",\"question\":\"Stomata allow gases, such as H2O and CO2, to exchange between the inside of a plant leaf and the surrounding environment. Which of the following occurs under normal daytime environmental conditions?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}