{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"81af34ac-a3c7-5c0c-b71a-cdc1c1a526be","task_key":"default--test--2058","task_revision_id":"1","upstream_id":"2058","short_description":"What is the basic goal and logic of psychotherapy and how isthis goal generally…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"Psychotherapy aims to improve a patient's athletic performance\\\", 'Psychotherapy is a method to diagnose mental illnesses', 'Psychotherapy is designed to help the patient achieve an effective and satisfactory adjustment by establishing a positive experience between a therapist and one or more patients or clients.', 'The goal of psychotherapy is to offer financial counseling to resolve economic issues', 'Psychotherapy is intended to facilitate weight loss through dietary advice and exercise regimes', 'Psychotherapy is aimed at improving physical health', 'Psychotherapy goal is to provide medications to patients', 'Psychotherapy is primarily about providing educational tutoring to enhance intellectual capacity', \\\"Psychotherapy seeks to alter a person's spiritual beliefs to improve their wellbeing\\\", \\\"The main objective of psychotherapy is to change a patient's personality completely\\\"]\",\"question\":\"What is the basic goal and logic of psychotherapy and how isthis goal generally achieved ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}