{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dfd76fa9-cfa0-52da-b5c4-8c7ac1245a36","task_key":"default--test--2411","task_revision_id":"1","upstream_id":"2411","short_description":"How does mass communication play a role in the formation of our attitudes and…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Mass communication only affects our political views', \\\"Mass communication's role in shaping our attitudes and beliefs is limited to the educational content we choose to engage with.\\\", 'Mass communication alters our attitudes and beliefs by reinforcing existing opinions without introducing new perspectives.', 'Mass communication shapes our attitudes and beliefs exclusively through the use of humor and entertainment.', 'Mass communication plays a role in the formation of our attitudes and beliefs by persuading us subtly to adopt certain attitudes, beliefs, or behaviors, often without us realizing it.', 'Mass communication primarily influences our attitudes and beliefs by providing factual information without any bias or persuasion.', 'Mass communication affects our attitudes and beliefs only through direct and explicit messages.', 'Mass communication has an impact on our attitudes and beliefs solely through the news and current events we are exposed to.', 'Mass communication has no impact on our attitudes and beliefs', 'Mass communication only influences our purchasing decisions']\",\"question\":\"How does mass communication play a role in the formation of our attitudes and beliefs?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}