{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b97133d3-85cc-57cb-807c-e8ad142a5ba6","task_key":"default--test--7280","task_revision_id":"1","upstream_id":"7280","short_description":"What is the 'trading possibilities frontier' ?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['It is a term for the trade deficit of a nation.', 'The trading possibilities frontier defines the legal limitations on the quantity of goods a nation can export.', 'It is the maximum trade capacity of a country.', 'It is the set of all trade agreements a country is a part of.', \\\"The trading possibilities frontier is the graphical representation of a country's currency value against others.\\\", 'The trading possibilities frontier illustrates the potential output of a nation after the gains from trade are taken into account.', \\\"It is a measure of the volume of trade that can flow through a nation's infrastructure.\\\", 'It represents the balance of trade equilibrium for a specific country.', 'The trading possibilities frontier describes the range of products a country is capable of importing without incurring debt.', 'It refers to the physical boundary for trading goods and services.']\",\"question\":\"What is the 'trading possibilities frontier' ?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}