{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"657f210a-2603-51c4-ac97-5f41284db8f1","task_key":"all--test--657f210a-2603-51c4-ac97-5f41284db8f1","task_revision_id":"1","upstream_id":"","short_description":"Diagnosis of iron deficiency can be complicated by concurrent infection since…","config":"all","split":"test","body":"{\"choices\":\"['Low haemoglobin, high ferritin, high serum transferrin receptors, high hepcidin', 'Low haemoglobin, low ferritin, high serum transferrin receptors, low hepcidin', 'Low haemoglobin, low ferritin, normal serum transferrin receptors, high hepcidin', 'Low haemoglobin, low ferritin, low serum transferrin receptors, high hepcidin']\",\"question\":\"Diagnosis of iron deficiency can be complicated by concurrent infection since many markers of iron status are altered by infection. Which of the following combinations of iron status markers is likely to be found in a person with both iron deficiency and a severe infection?\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}