{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7430289c-2ec3-510a-bcd1-18b12a02c139","task_key":"default--test--2559","task_revision_id":"1","upstream_id":"2559","short_description":"How has the way psychologists view infants changed over the years?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Psychologists now emphasize the functions that an infant can perform considering his lack of development and learning abilities.', 'Psychologists see infants as capable of complex reasoning and abstract thought comparable to adults.', \\\"Psychologists think infants' behavior is random and not indicative of cognitive processes.\\\", 'Psychologists believe infants have no capacity for learning until they reach toddler age.', 'Psychologists now understand infants to communicate at the same level as adults.', 'Psychologists consider infants to be miniature adults with all capacities developed.', 'Psychologists still view infants as inadequate and passive humans.', 'Psychologists no longer study infant behavior.', 'Psychologists view infants as being influenced only by genetics, with no impact from their environment.', 'Psychologists now view infants as fully developed humans.']\",\"question\":\"How has the way psychologists view infants changed over the years?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}