{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53c713cb-f9d0-5c13-b773-1286c84b8921","task_key":"default--test--2469","task_revision_id":"1","upstream_id":"2469","short_description":"What is social power? Discuss three types of social power.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Social power is the ability to control the resources of a society. Three types of social power are resource control power, distributive power, and associative power.', 'Three types of social power are educational social power, charismatic social power, and punitive social power.', 'Social power is the ability to influence cultural norms. Three types of social power are traditional social power, informational social power, and expressive social power.', 'Social power is the ability to change the attitudes or behavior of an individual. Three types of social power are legitimate social power, referent social power, and reward or coercive social power.', 'Social power is the ability to change the social status of an individual', 'Social power is the capacity to enforce legal decisions. Three types of social power are judicial social power, legislative social power, and executive social power.', 'Three types of social power are coercive social power, economic social power, and political social power', 'Three types of social power are persuasive social power, identity social power, and expert social power.', 'Social power is the ability to alter public opinion. Three types of social power are media social power, celebrity social power, and grassroots social power.', 'Social power is the ability to control the economic status of an individual']\",\"question\":\"What is social power? Discuss three types of social power.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}