{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0677f733-855a-5552-8c55-70e79ecfd995","task_key":"default--test--5938","task_revision_id":"1","upstream_id":"5938","short_description":"Which of the following is LEAST likely to explain low voter turnout for an…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['High levels of satisfaction with the current political situation', \\\"Voters' lack of knowledge about the candidates\\\", 'The complexity of the voting process', 'The frequency with which state and local elections occur', 'Regulations that require voters to show identification', 'The preclearance provision of the Voting Rights Act', 'Low levels of political efficacy among registered voters', 'High levels of political apathy among younger voters', 'A large number of independent candidates', 'Poor weather conditions on election day']\",\"question\":\"Which of the following is LEAST likely to explain low voter turnout for an election?\",\"src\":\"ori_mmlu-high_school_government_and_politics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}