{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6f92d13-7e64-563b-8265-87f92e5cbdb6","task_key":"default--test--2254","task_revision_id":"1","upstream_id":"2254","short_description":"Define emotion in terms of feelings, responses, and motivation.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Emotion is a state of anger.', 'Emotion is a behavioral display intended to influence others, without internal feelings or motivations.', 'Emotion is the conscious experience of affect, limited to situations of pleasure or pain.', 'Emotion is a state of happiness.', 'Emotion is a complex state characterized by heightened arousal level, defined in terms of feelings, responses, and motivation.', 'Emotion is an involuntary physical reaction to external events, unrelated to personal feelings or motivation.', 'Emotion is a long-lasting mood state that does not necessarily have a triggering event or clear external cause.', 'Emotion is the physiological response to cognitive judgments about social and environmental stimuli.', 'Emotion is a transient social construct that varies widely across cultures and situations.', 'Emotion is a state of sadness.']\",\"question\":\"Define emotion in terms of feelings, responses, and motivation.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}