{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4940c59a-951c-5b73-a222-8c642efa7fa0","task_key":"default--test--2431","task_revision_id":"1","upstream_id":"2431","short_description":"A family therapist using the structural approach of Salvador Minuchin would most…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['use a single-therapist model to maintain consistency.', 'solely focus on individual therapy sessions with each family member.', 'work initially with the most differentiated family member.', 'avoid discussing family dynamics and focus on external factors.', 'encourage family members to solve their issues independently without intervention.', '\\\"avoid issuing \\\"\\\"directives\\\"\\\" and let the family find their own solutions.\\\"', '\\\"use a multiple-therapist team to prevent any one therapist from becoming \\\"\\\"triangulated\\\"\\\" into the family system.\\\"', '\\\"encourage \\\"\\\"groupthink\\\"\\\" to ensure family harmony.\\\"', 'clarify boundaries between family members in order to reduce enmeshment.']\",\"question\":\"A family therapist using the structural approach of Salvador Minuchin would most likely:\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}