{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"15219d26-f061-5c14-aba8-2afe91932c3f","task_key":"default--test--2753","task_revision_id":"1","upstream_id":"2753","short_description":"What is the major task of aRogerian(or client-oriented) therapist ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['To conduct psychological tests to diagnose the client', \\\"To prescribe medication for the client's mental health issues\\\", \\\"To analyze the client's past traumas in every session\\\", \\\"To find a cure for the client's issues\\\", 'To judge and evaluate the client', \\\"To focus on changing the client's behaviors through reinforcement\\\", \\\"To interpret the client's behavior\\\", \\\"To provide direct solutions to the client's problems\\\", 'To establish an atmosphere which lets the client be open to experience', \\\"To challenge the client's beliefs and attitudes\\\"]\",\"question\":\"What is the major task of aRogerian(or client-oriented) therapist ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}