{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c05225fd-9dc0-5a40-9dc5-292d92d9def5","task_key":"default--test--7611","task_revision_id":"1","upstream_id":"7611","short_description":"What is the purpose of the National Accounts?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['National Accounts document the financial transactions of a nation', \\\"National Accounts provide a detailed demographic breakdown of a nation's population\\\", 'National Accounts assess the environmental impact of economic activities', 'National Accounts monitor the national debt', 'The National Accounts measure the total value of the output of the economy and show where the output originates and how it is allocated.', 'National Accounts determine the tax rates for different income brackets', 'National Accounts regulate international trade agreements', 'National Accounts track the income of individuals', 'National Accounts calculate the gross domestic product (GDP) per capita only', 'National Accounts compile and analyze consumer spending habits only']\",\"question\":\"What is the purpose of the National Accounts?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}