{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"84bfa76a-35e3-5b20-8891-1b5cf006afc2","task_key":"all--test--84bfa76a-35e3-5b20-8891-1b5cf006afc2","task_revision_id":"1","upstream_id":"","short_description":"What is the likely reason that evidence to support the relationship between…","config":"all","split":"test","body":"{\"choices\":\"['The complexity of the mechanisms regulating the absorption of cholesterol and its export in lipoproteins.', 'The complexity of the mechanism controlling the clearance of intestinally derived lipoproteins by the liver.', 'The multiple intrahepatic responses to increased cellular cholesterol.', 'All of the above.']\",\"question\":\"What is the likely reason that evidence to support the relationship between dietary cholesterol and plasma LDL cholesterol levels in humans is inconclusive?\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}