{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef69c10e-f65e-5fbc-aaaa-5a52061c2e11","task_key":"default--test--2409","task_revision_id":"1","upstream_id":"2409","short_description":"Which of the following best summarizes Carl Rogers' view of personality?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Personality is formed mainly by the social roles and expectations one assumes.', 'Personality is mainly formed by behavioral expectations.', 'Personality traits are mostly negative and destructive.', \\\"Personality is largely determined by one's genetic makeup.\\\", \\\"People's personality traits are overwhelmingly positive and goal-directed.\\\", 'Personality is the result of unconscious desires and conflicts.', 'Personality traits such as inhibition, extroversion, and conscientiousness are constant over time.', \\\"Personality is constant and unchanging throughout one's life.\\\", 'Individual personalities vary based on differences in traits, emotions, and thought processes.', 'Personality is a result of external environmental influences.']\",\"question\":\"Which of the following best summarizes Carl Rogers' view of personality?\",\"src\":\"ori_mmlu-high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}