{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4371932-72b3-5e90-ba51-e5644d694619","task_key":"default--test--5643","task_revision_id":"1","upstream_id":"5643","short_description":"Which of the following statements is the most significant characteristic in…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['The activity is financed by grants and contributions that are restricted for specific purposes.', \\\"The activity's revenue is predominantly generated from investment income.\\\", 'The activity is financed by debt that is secured partially by a pledge of the net revenues from fees and charges of the activity.', 'The pricing policies of the activity establish fees and charges designed to recover its cost.', 'The activity is financed by debt that is secured solely by a pledge of the general revenues from taxes.', 'The predominant customer is the primary government.', 'Laws or regulations require that the activity’s costs of providing services including capital costs be recovered with taxes or similar revenues.', \\\"Laws or regulations require that the activity's costs of providing services be subsidized by general fund appropriations.\\\", 'The activity is funded primarily through intergovernmental revenues.', \\\"The activity's costs of providing services are primarily financed through sales of goods or services to the general public.\\\"]\",\"question\":\"Which of the following statements is the most significant characteristic in determining the classification of an enterprise fund?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}