{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02ef77ba-904e-59c5-bdaa-83be7fbcb7a8","task_key":"default--test--2040","task_revision_id":"1","upstream_id":"2040","short_description":"Verbal stimuli may be an acquired source of drive. Discuss.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Verbal cues are effective as motivational sources only in specific cultural contexts.', 'Only non-verbal stimuli can serve as sources of drive.', 'Verbal stimuli serve as a source of drive exclusively in early childhood development.', 'Verbal stimuli are an innate source of drive, not acquired.', 'Verbal stimuli are not an acquired source of drive.', 'Verbal stimuli only affect animals, not humans.', 'Verbal stimuli can only motivate if accompanied by physical reinforcement.', 'Verbal stimuli have no motivational properties and are purely informational.', 'Language has no influence on human behavior.', 'Certain verbal cues may become acquired motivational sources, mainly through the learned responses that they evoke.']\",\"question\":\"Verbal stimuli may be an acquired source of drive. Discuss.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}