{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f29f934-5655-511e-ab36-ec091dc0385a","task_key":"default--test--2475","task_revision_id":"1","upstream_id":"2475","short_description":"What methods are generally viewed as helpful in reducing prejudice?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Implementing a quota system in all sectors of society', 'Use of subliminal messaging to alter beliefs', 'Providing information contrary to beliefs, equal-status contact, and interdependence', 'Promoting segregation to reduce intergroup conflict', 'Encouraging individuals to avoid discussing or acknowledging differences', 'Direct confrontation of prejudiced beliefs', 'Strict enforcement of penalties for prejudiced behavior', 'Public information campaigns', 'Mandatory diversity training for all citizens', 'Forcing desegregation and busing']\",\"question\":\"What methods are generally viewed as helpful in reducing prejudice?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}