{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98eaca54-6650-5be7-b2c3-2d2c337162af","task_key":"default--test--6938","task_revision_id":"1","upstream_id":"6938","short_description":"Why are United States coins called \"token money\"?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The coins are produced as commemorative tokens for collectors', 'The coins are minted by private organizations rather than the government', 'The coins are only accepted as currency within certain states', \\\"The value of the metal in each coin is far less than the coin's monetary value\\\", 'The coins have historical significance', 'The coins are used as a form of barter rather than as legal tender', \\\"The coins are backed by the government's promise to pay the face value\\\", 'The coins are replicas of ancient currency used for educational purposes', 'The coins are made of cheap metal', 'The coins are used as tokens in games']\",\"question\":\"Why are United States coins called \\\"token money\\\"?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}