{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b1dcfde2-e218-5cb4-9629-96a028f17001","task_key":"all--test--b1dcfde2-e218-5cb4-9629-96a028f17001","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is a true statement about the flow of energy in an…","config":"all","split":"test","body":"{\"choices\":\"['Smaller organisms need less energy per gram of body weight than do larger organisms.', 'Energy transfer between organisms normally involves conservation of heat energy.', 'Energy flow between trophic levels is inefficient.', 'Chemical energy is converted into radiant energy, which is then converted into chemical energy at the next trophic level.']\",\"question\":\"Which of the following is a true statement about the flow of energy in an ecosystem?\",\"subject\":\"miscellaneous\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}