{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"209d328a-dece-5060-814e-9d3d5d1653f8","task_key":"default--test--6949","task_revision_id":"1","upstream_id":"6949","short_description":"What is the advantage of using money in trade as compared tobarter trade?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Money restricts trading to individuals who meet all requirements.', 'Barter trade ensures immediate and equivalent exchanges without the need for money.', 'Barter trade is universally acceptable in exchange.', 'Money has an intrinsic value which is recognized globally.', 'Money increases the complexity of finding a trading partner.', 'The use of money requires physical exchange of goods at the time of transaction.', 'Money allows for direct exchange of goods without the need for a common measure of value.', 'The use of money reduces the difficulty of finding a trading partner, and facilitates mutually beneficial exchanges.', 'Barter trade allows for easier standardization of value across different goods and services.']\",\"question\":\"What is the advantage of using money in trade as compared tobarter trade?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}