{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"483bf7b2-d040-5422-91d7-842dfdf68172","task_key":"default--test--7494","task_revision_id":"1","upstream_id":"7494","short_description":"Which of the following statements is true of production possibility curves and…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Domestic industries should be protected to ensure nations stay within their production possibility curve.', 'The flow of goods and services is based on the principle of absolute advantage.', 'Nations can consume at points beyond the production possibility curve by protecting domestic industries from free trade.', 'Trade between nations does not affect the production possibility curve.', 'Nations should only trade when they have a comparative advantage in production.', 'Free trade restricts nations to consume within their production possibility curve.', 'The principle of comparative advantage is irrelevant in the context of international trade.', 'Nations specialize and trade based on absolute advantage in production.', 'Production possibility curves demonstrate that trade always results in absolute disadvantage.', 'Free trade allows each nation to consume beyond the production possibility curve.']\",\"question\":\"Which of the following statements is true of production possibility curves and trade between nations?\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}