{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4e1c9df0-8c58-5f72-853b-7077e7cc9896","task_key":"default--test--2100","task_revision_id":"1","upstream_id":"2100","short_description":"Each of the following is a step taken by a therapist who is employing systematic…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['having the client confront the actual feared object or situation', 'instructing the client to picture each fearful image while maintaining a relaxed state', 'constructing a hierarchy of feared images', 'helping the client experience the desired state of relaxation through hypnosis', 'instructing the client to express their feelings about each feared image', 'using exposure therapy to desensitize the client to feared images', 'using guided imagery to help the client visualize confronting their fears']\",\"question\":\"Each of the following is a step taken by a therapist who is employing systematic desensitization EXCEPT\",\"src\":\"ori_mmlu-high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}