{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6a448c6-ae2a-5958-b768-1434b70000d5","task_key":"all--test--f6a448c6-ae2a-5958-b768-1434b70000d5","task_revision_id":"1","upstream_id":"","short_description":"Which of the following statements is the most significant characteristic in…","config":"all","split":"test","body":"{\"choices\":\"['The predominant customer is the primary government.', 'The pricing policies of the activity establish fees and charges designed to recover its cost.', 'The activity is financed by debt that is secured partially by a pledge of the net revenues from fees and charges of the activity.', 'Laws or regulations require that the activity’s costs of providing services including capital costs be recovered with taxes or similar revenues.']\",\"question\":\"Which of the following statements is the most significant characteristic in determining the classification of an enterprise fund?\",\"subject\":\"professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}