{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f1aa3530-7569-5deb-a013-7a2ecbbcdfe8","task_key":"default--test--2733","task_revision_id":"1","upstream_id":"2733","short_description":"Discuss the four processes involved in observational learningaccording…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Cognitive process, Behavioural process, Emotional process, Perceptual process', 'Attention process, Retention process, Reproduction process, Motivational process', 'Awareness process, Interpretation process, Decision process, Reward process', 'Observation process, Imitation process, Trial and Error process, Association process', 'Perception process, Memory process, Social process, Emotional Regulation process', 'Acquisition process, Performance process, Generalization process, Discrimination process', 'Classical conditioning, Operant conditioning, Habituation, Sensitization', 'Sensory process, Integration process, Response process, Feedback process', 'Encoding process, Consolidation process, Recall process, Reinforcement process', 'Identification process, Modeling process, Outcome process, Vicarious Reinforcement process']\",\"question\":\"Discuss the four processes involved in observational learningaccording toBanduraand Walters.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}