{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c236ac66-225b-54d2-a30d-7bd020f6eca7","task_key":"default--test--2057","task_revision_id":"1","upstream_id":"2057","short_description":"What are some of the theories which support a belief that aggression is…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['\\\"Aggressive Energy\\\" theory and \\\"Natural Born Killer\\\" theory', '\\\"Game\\\" theory and \\\"Cognitive Neoassociation\\\" theory', '\\\"Psychoanalytic\\\" theory and \\\"Drive\\\" theory', '\\\"Dominance\\\" theory and \\\"Behaviorist\\\" theory', '\\\"Evolution\\\" theory and \\\"Conflict\\\" theory', '\\\"Social Learning\\\" theory and \\\"Biological\\\" theory', '\\\"Survival of the fittest\\\" theory and \\\"Catharsis\\\" theory']\",\"question\":\"What are some of the theories which support a belief that aggression is necessary?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}