{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23447a9f-deba-54ec-ae04-3ea766416bec","task_key":"default--test--2498","task_revision_id":"1","upstream_id":"2498","short_description":"Discuss the relationship between arousal and motivation.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Motivation can exist without any form of arousal.', 'Arousal level is a central aspect of motivation.', 'Motivation is the cause of arousal.', 'Motivation is a by-product of arousal.', 'High arousal always maximizes motivation.', 'Arousal is the same as motivation.', 'Motivation decreases with increased arousal.', 'Arousal and motivation are not related.', 'Arousal only affects motivation in physical tasks.']\",\"question\":\"Discuss the relationship between arousal and motivation.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}