{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2053b018-e8e7-5c01-a7fb-e5a43c2820c5","task_key":"default--test--7523","task_revision_id":"1","upstream_id":"7523","short_description":"In a frictionless world economy, resources would be perfectly mobile. As it is…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Trade causes the price of resources to skyrocket', 'Trade causes the price of resources to become more volatile', 'Trade roughly matches up the worldwide demand for resources, with the world-wide supply.', 'Trade leads to a scarcity of resources in regions with comparative disadvantage', 'Trade results in an equal distribution of resources across all countries regardless of supply and demand', 'Trade perpetuates the immobility of resources by creating dependency on imports', 'Trade eliminates the need for resource mobility', 'Trade leads to a surplus of resources', 'Trade consistently reduces the worldwide demand for resources', 'Trade ensures that resources are only allocated to the most developed economies']\",\"question\":\"In a frictionless world economy, resources would be perfectly mobile. As it is now, immigration, emigration and capital outflow restrictions severely limit resource mobility. How do the changes in supply and demand, and the consequent price changes, brought about by application of comparative advantage, tend to compensate for the immobility of re- sources .\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}