{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ba9795c0-1f9d-571c-a7de-0435202fda30","task_key":"default--test--7538","task_revision_id":"1","upstream_id":"7538","short_description":"What is the difference between gross national product and national income?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['GNP is the total income of a nation, while NI is the total income earned by individuals', 'GNP is the value of all goods and services produced in a year, while NI is the total income earned by those who contribute to current production, after deductions for indirect taxes, depreciation and the use of capital.', \\\"GNP includes only the income earned within a country's borders, while NI includes income from abroad\\\", 'GNP is the value of all finished products produced by a country, while NI is the value of all raw materials produced by a country', 'GNP is the total income from domestic and foreign sources, while NI is the total income generated exclusively from foreign investments', \\\"GNP is the market value of all final goods and services produced by a country's residents, while NI is the sum of all wages, profits, and rents earned by a country's residents\\\", 'GNP measures the economic output, while NI measures the economic input', 'GNP is the sum of all governmental spending, while NI is the sum of all consumer spending', \\\"GNP is the total income earned by a nation's corporations, while NI includes only the income earned by its citizens\\\", 'GNP is the total export value, while NI is the total import value']\",\"question\":\"What is the difference between gross national product and national income?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}