{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b9b319f7-24df-553f-87a6-e08eba6dd223","task_key":"default--test--5066","task_revision_id":"1","upstream_id":"5066","short_description":"Interest groups representing businesspeople and investors are often among the…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Such groups have the financial resources to mount sustained campaigns on their own behalf.', 'These groups often have a higher level of political influence due to their financial status.', 'Businesspeople and investors are often more educated about legislative processes.', \\\"These groups' constituents contribute heavily to many legislators' campaigns, and in doing so, gain greater access to legislators.\\\", 'Businesspeople and investors have a more direct impact on the economy, thus gaining more attention from legislators.', 'These groups are often more organized and efficient in their lobbying efforts.', \\\"In many districts, these groups' constituents make up the majority of voters.\\\", 'These groups can use their resources to influence public opinion through media campaigns.', 'Many such groups have been in existence for several decades or more, allowing them to master the legislative system and to develop close ties with legislators.']\",\"question\":\"Interest groups representing businesspeople and investors are often among the most successful lobbying groups in Washington, D.C., for all of the following reasons EXCEPT\",\"src\":\"ori_mmlu-high_school_government_and_politics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}