{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0beb490-14db-56bb-a0c3-79f1d145acdd","task_key":"default--test--2201","task_revision_id":"1","upstream_id":"2201","short_description":"What is termed “catharsis” in psychoanalytic theory might be described by…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['redirection of anxiety because of therapeutic influences', 'a decrease in affective responses because of therapeutic directions to the client to make such decreases', 'a method to address suppressed traumatic experiences', 'an elevation of emotional response due to cognitive behavior therapy', 'a shift in behavioral patterns due to therapeutic suggestions', 'reduction of emotional response by an extinction procedure', 'a control of emotional response due to positive reinforcement', 'a decrease in anxiety levels due to mindfulness techniques', 'increase in emotional response due to therapeutic interventions', 'inhibition of emotional response because of learned cognitive controls']\",\"question\":\"What is termed “catharsis” in psychoanalytic theory might be described by behaviorists as\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}