{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a774503-6922-5950-883e-606b0f27e2ff","task_key":"default--test--7528","task_revision_id":"1","upstream_id":"7528","short_description":"Describe the effect of an export quota and export tax on such a product as…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['An export quota or export tax will primarily benefit importers of soybeans in foreign markets', 'An export quota or export tax will benefit domestic producers', 'An export quota or export tax will lead to a global surplus of soybeans, driving prices down', 'An export quota or export tax will ensure a stable income for soybean farmers irrespective of market prices', 'An export quota or export tax will benefit domestic consumers by keeping the domestic price lower than the world price.', 'An export quota or export tax will decrease the world price of soybeans by increasing global competition', 'An export quota or export tax will decrease the supply of soybeans in domestic market', 'An export quota or export tax will have no significant impact on the price or supply of soybeans']\",\"question\":\"Describe the effect of an export quota and export tax on such a product as soybeans.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}