{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c5a22dcd-f508-515e-9235-83ddcf65776b","task_key":"default--test--6090","task_revision_id":"1","upstream_id":"6090","short_description":"The perspective that development is embedded in history means that","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Only physical development is influenced by age', 'Some characteristics change with age while others do not', 'All individuals experience development at the same pace', 'Development is dependent solely on genetic factors', 'Developmental changes are always positive', 'Sociocultural conditions must always be considered', 'Development in any particular areas (e.g., social) is tied to development in other areas (e.g., cognitive)', 'Development is unaffected by external influences', 'Change can always occur regardless of age', 'History has no impact on individual development']\",\"question\":\"The perspective that development is embedded in history means that\",\"src\":\"ori_mmlu-human_aging\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}