{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f2773a90-e162-5333-bde4-802d87c2aec1","task_key":"all--test--f2773a90-e162-5333-bde4-802d87c2aec1","task_revision_id":"1","upstream_id":"","short_description":"Why might some biochemical (eg plasma or serum) indices of micronutrient status…","config":"all","split":"test","body":"{\"choices\":\"['Because people who are sick often alter their diets, and may eat less food.', 'Because the accuracy of some laboratory assays may be compromised in samples from people who are sick.', 'Because some metabolic pathways are altered in sick people, which changes their micronutrient requirements.', 'Because an acute phase reaction results in changes in inter-tissue distributions of certain micronutrients.']\",\"question\":\"Why might some biochemical (eg plasma or serum) indices of micronutrient status give misleading results in people with infections or inflammatory states?\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}