{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6d982fde-c042-59a0-b149-f71c70e60b4e","task_key":"default--test--2568","task_revision_id":"1","upstream_id":"2568","short_description":"According to HERSEY and BLANCHARD’S SITUATIONAL LEADERSHIP MODEL, leader style…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['high task-orientation and high relationship orientation', 'high task-orientation and low relationship orientation', 'moderate task orientation and moderate relationship orientation', 'no relationship orientation and high task orientation', 'low task orientation and low relationship orientation', 'no task orientation and no relationship orientation', 'high relationship orientation and no task orientation', 'low task orientation and high relationship orientation', 'high task orientation and no relationship orientation', 'moderate task orientation and high relationship orientation']\",\"question\":\"According to HERSEY and BLANCHARD’S SITUATIONAL LEADERSHIP MODEL, leader style is described in terms of task and relationship orientation and optimal style depends on job maturity and subordinates. How is it the Delegating Style?\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}