{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3706681c-255a-5dd7-9299-5c0ed8e3c93f","task_key":"default--test--2434","task_revision_id":"1","upstream_id":"2434","short_description":"A company president is concerned about the low motivation and satisfaction of…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['ERG theory', \\\"Maslow's Hierarchy of Needs\\\", 'Goal-setting Theory', 'Job Characteristics Model', 'Reinforcement Theory', 'two-factor theory', 'Self-Determination Theory', 'expectancy theory', 'Attribution Theory', 'equity theory']\",\"question\":\"A company president is concerned about the low motivation and satisfaction of her employees and, as a result, institutes a wage and bonus (financial) incentive program for all employees. Six months later, the president finds that her efforts have not increased the employees' job motivation or satisfaction. This result is best predicted by which of the following theories?\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}