{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a13e748e-8d8a-5831-a2e4-30912ed22644","task_key":"default--test--2310","task_revision_id":"1","upstream_id":"2310","short_description":"Discuss the influence of heredity on personality.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Personality is influenced exclusively by early childhood experiences, with no genetic component.', 'Personal experiences have no impact on personality, which is predetermined at birth.', 'Twin studies have shown that both genetic and environmental factors influence personality.', 'Personality is determined by a complex algorithm that predicts behavior patterns with 100% accuracy.', 'Personality is solely determined by heredity.', 'Only environmental factors influence personality.', 'Genetic factors influence personality to a small extent, with diet being the predominant factor.', 'Personality is not influenced by heredity at all.', 'Personality is shaped by the phases of the moon at the time of birth, with no influence from heredity or environment.', 'Heredity determines personality traits until the age of 10, after which the environment takes over completely.']\",\"question\":\"Discuss the influence of heredity on personality.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}