{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d7e31307-75de-5cb1-ac7c-d334f6677d01","task_key":"default--test--2751","task_revision_id":"1","upstream_id":"2751","short_description":"How would a Freudian treatagoraphobia ?How might a behaviorist ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Freudian therapist would use positive reinforcement, while a behaviorist might use dream interpretation.', 'Freudian therapist would focus on changing thought patterns, while a behaviorist might use operant conditioning.', 'Freudian therapist would use client-centered therapy, while a behaviorist might use biofeedback.', 'Freudian therapist would use cognitive restructuring, while behaviorist might use aversion therapy.', 'Freudian therapist would use exposure therapy, while behaviorist might use hypnosis.', 'Freudian therapist would use aversion therapy, while a behaviorist might use free association.', 'Freudian therapist would use free association, dream analysis and interpretation, whereas a behaviorist might use techniques like desensitization, reinforcement, relaxation, shaping, and stimulus generalization.', 'Freudian therapist would use electroconvulsive therapy (ECT), while a behaviorist might use transactional analysis.', 'Freudian therapist would use medication, while behaviorist might use mindfulness-based therapies.', 'Freudian therapist would use systematic desensitization, while a behaviorist might use psychoanalysis.']\",\"question\":\"How would a Freudian treatagoraphobia ?How might a behaviorist ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}