{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8335a596-1d02-547e-916e-4ebfcb9eded9","task_key":"default--test--5361","task_revision_id":"1","upstream_id":"5361","short_description":"All of the following contribute to lower voting rates among Americans in the…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['the belief that their vote will not make a difference', 'the remoteness of most political issues to the daily lives of young people', \\\"frequent relocation of one's primary residence\\\", 'the fact that the minimum voting age in some states is 21', 'the fact that voting is not mandatory', 'difficulty understanding the voting process', 'a lack of interest in politics', \\\"college attendance in a state other than one's home state\\\", 'the perception that all political candidates are the same', 'an inability to get to polling locations']\",\"question\":\"All of the following contribute to lower voting rates among Americans in the 18-to-25 age bracket EXCEPT\",\"src\":\"ori_mmlu-high_school_government_and_politics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}