{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1725cb15-5ffa-5661-96ed-9b66881a0273","task_key":"default--test--7411","task_revision_id":"1","upstream_id":"7411","short_description":"Does the principle of comparative advantage apply only to international trade?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['No, it is a principle that applies only to consumer choice in the market.', 'No, it is only applicable to the exchange of services, not goods.', 'Yes, it specifically applies to trade agreements between neighboring countries.', 'No, it applies wherever productive units have different relative efficiencies.', 'Yes, it only applies to international trade.', 'No, it applies only to domestic trade.', 'No, it applies only to financial transactions in capital markets.', 'Yes, it is relevant solely for barter transactions across international borders.', 'No, it applies only to the division of labor within a company.', 'Yes, it applies exclusively to trade between countries within the same continent.']\",\"question\":\"Does the principle of comparative advantage apply only to international trade?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}