{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e3c5154-a144-5d8a-810c-4013762c6df0","task_key":"all--test--1e3c5154-a144-5d8a-810c-4013762c6df0","task_revision_id":"1","upstream_id":"","short_description":"Which of the following statements about nutritional status and health outcomes…","config":"all","split":"test","body":"{\"choices\":\"['Hypertension in older people is unlikely to be associated with high salt intake.', 'There is strong evidence that supplements of vitamin B12 will improve cognitive function in older people.', 'Older people are no more likely to have low haemoglobin concentration than younger people.', 'Folate deficiency in older people is less prevalent in countries with mandatory fortification of flour with folic acid.']\",\"question\":\"Which of the following statements about nutritional status and health outcomes is correct?\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}