{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"418b82f9-6e26-5ed2-bd74-435104727d7c","task_key":"default--test--2086","task_revision_id":"1","upstream_id":"2086","short_description":"HOUSE’S PATH-GOAL THEORY OF LEADERSHIP predicts that subordinate satisfaction…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['focuses on creating a positive work environment', 'includes subordinates in decision-making', 'provides feedback and recognition for a job well done', 'encourages subordinates to work independently', 'sets challenging goals and encourage higher levels of performance', 'establishes supportive relationships with subordinates', 'emphasizes the importance of team building and collaboration', 'places a high value on employee engagement and participation', 'encourages subordinates to develop their own goals and objectives', 'provides specific guidelines and clear rules and procedures']\",\"question\":\"HOUSE’S PATH-GOAL THEORY OF LEADERSHIP predicts that subordinate satisfaction and motivation are maximized when they believe the leader is helping. How is the Instrumental leadership style?\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}