{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1c872219-ef93-5215-91c8-3dff4cdbfab0","task_key":"default--test--2412","task_revision_id":"1","upstream_id":"2412","short_description":"Discuss the three basic goals of psychology.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['To improve educational systems, to prevent global crises, and to understand animal behavior', 'To explore spiritual experiences, to enhance creativity, and to increase wealth', 'The three basic goals of psychology are: to measure and describe behavior, to predict and control behavior, and to understand and explain behavior.', 'To advance cognitive performance, to understand celestial phenomena, and to invent new technologies', 'To predict economic trends, to create artistic masterpieces, and to explore oceanic depths', 'To develop artificial intelligence, to map the human genome, and to solve mathematical problems', 'To study the human mind, to understand human emotions, and to promote mental health', 'To diagnose and treat psychological disorders, to improve interpersonal relationships, and to promote self-understanding', 'To understand human development, to study social interactions, and to promote positive behavior', 'To prescribe medication for all psychological issues, to ensure societal conformity, and to explain historical events']\",\"question\":\"Discuss the three basic goals of psychology.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}