{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"785b0c17-8299-5f42-9087-65f3dd9f1fbc","task_key":"all--test--785b0c17-8299-5f42-9087-65f3dd9f1fbc","task_revision_id":"1","upstream_id":"","short_description":"In the past two decades, interest in maternal nutrition has been heightened…","config":"all","split":"test","body":"{\"choices\":\"['although early life may appear to be important, observed links to risk of cardiovascular disease and type 2 diabetes can be largely explained by adult lifestyle', 'the observed links between early experience and later health have only been seen in UK studies', 'the epidemiological evidence shows programmed differences in physiology are only linked to events before birth', 'the epidemiological evidence shows programmed differences in physiology are linked to events before birth and in early postnatal life']\",\"question\":\"In the past two decades, interest in maternal nutrition has been heightened following the findings of epidemiological studies that show links between early experience and later health. Which of the following statements is true:\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}