{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7e70aa6f-e569-564b-aac2-a18837439f58","task_key":"default--test--2309","task_revision_id":"1","upstream_id":"2309","short_description":"Discuss the two types of behavior that can result from an avoidance-avoidance…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Indecision and escalation', 'Aggression and passive resistance', 'Procrastination and denial', 'Displacement and rationalization', 'Overcompensation and withdrawal', 'Negotiation and compromise', 'Acceptance and engagement', 'Vacillation and attempting to leave the field', 'Submission and avoidance', 'Confrontation and resolution']\",\"question\":\"Discuss the two types of behavior that can result from an avoidance-avoidance conflict.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}