{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be76a2a2-86c9-5474-9a37-75d328f66f9f","task_key":"default--test--5537","task_revision_id":"1","upstream_id":"5537","short_description":"Which of the following is an example of a concurrent power?","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['The power to regulate commerce with foreign nations', 'The printing and coining of money', 'The power to establish post offices', 'The process of naturalization', 'The power to appoint ambassadors and other public ministers.', 'The power to propose amendments to the Constitution', 'The power to establish a national bank', 'The levying of taxes', 'The power to declare war', 'The power to make laws necessary and proper for executing other powers']\",\"question\":\"Which of the following is an example of a concurrent power?\",\"src\":\"ori_mmlu-miscellaneous\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}