{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9eeadf02-3989-51e2-9f55-1784e11ae695","task_key":"all--test--9eeadf02-3989-51e2-9f55-1784e11ae695","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is the best explanation for why net primary productivity…","config":"all","split":"test","body":"{\"choices\":\"['The higher species diversity in the tropics tends to increase plant growth.', 'There are lower metabolic costs to plant growth in the tropics.', 'The availability of water and warm temperatures in the tropics fosters photosynthesis.', 'The tropics have more predators that minimize herbivory.']\",\"question\":\"Which of the following is the best explanation for why net primary productivity in terrestrial ecosystems tends to increase toward the tropics?\",\"subject\":\"college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}