{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d757aeb9-f02c-5aef-868c-dc50ef7a2b89","task_key":"default--test--2670","task_revision_id":"1","upstream_id":"2670","short_description":"What is the role of psychological inconsistency in the theory of cognitive…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Psychological inconsistency in the theory of cognitive dissonance prompts a person to increase the importance of consistent beliefs or actions.', 'Psychological inconsistency in the theory of cognitive dissonance results in a person seeking external validation to justify the dissonant beliefs or actions.', 'Psychological inconsistency in the theory of cognitive dissonance leads to a state of equilibrium where dissonant and consonant elements coexist without any change.', 'Psychological inconsistency is deemed irrelevant in the theory of cognitive dissonance and has no effect on behavior or attitudes.', 'Psychological inconsistency in the theory of cognitive dissonance is an indicator of mental illness.', 'Psychological inconsistency in the theory of cognitive dissonance leads to an increase in the dissonant beliefs or actions.', 'Psychological inconsistency in the theory of cognitive dissonance is typically resolved through the intervention of a professional therapist.', 'Psychological inconsistency in the theory of cognitive dissonance motivates a person to ignore the dissonant elements.', 'Psychological inconsistency in the theory of cognitive dissonance is resolved through the development of new, unrelated attitudes or actions.', 'Psychological inconsistency in the theory of cognitive dissonance motivates a person to change either the attitude or action that is responsible for the dissonance.']\",\"question\":\"What is the role of psychological inconsistency in the theory of cognitive dissonance?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}