{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7793e846-11d8-5197-bc9d-d77369f5b1d1","task_key":"all--test--7793e846-11d8-5197-bc9d-d77369f5b1d1","task_revision_id":"1","upstream_id":"","short_description":"Which of the following best explains why people can digest starch but cannot…","config":"all","split":"test","body":"{\"choices\":\"['The bonds linking the monomers of starch differ in shape from the bonds linking the monomers of cellulose.', 'Molecules of starch are much smaller than molecules of cellulose.', 'Starch is an intracellular molecule, while cellulose is an extracellular molecule.', 'Starch is hydrated by water, but cellulose is not.']\",\"question\":\"Which of the following best explains why people can digest starch but cannot digest cellulose even though both molecules are composed of glucose monomers?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}