{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7567694d-f3c0-5345-8a2e-2e356f6ef00d","task_key":"default--test--5070","task_revision_id":"1","upstream_id":"5070","short_description":"Which of the following statements best characterizes cooperative federalism?","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['The federal government and state governments working against each other', 'State and federal governments working on the same issue', 'States having complete authority over all issues within their borders', 'The federal government imposing policies on the states without their consent', 'State governments making decisions without any federal government involvement', 'Governments working with businesses to address an issue', 'The federal government having complete control over all policy areas', 'The federal government and state governments working independently on different issues', 'The executive and legislative branches working on legislation together', 'The federal government granting power over a policy area to the states']\",\"question\":\"Which of the following statements best characterizes cooperative federalism?\",\"src\":\"ori_mmlu-high_school_government_and_politics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}