{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e92c4ab-fc33-5bd1-b6e9-dd06399ccab1","task_key":"default--test--2602","task_revision_id":"1","upstream_id":"2602","short_description":"Pay incentives are not always a feasible or effective way of improvingemployee…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Pay incentives work best when they are given randomly rather than based on performance metrics.', 'The effectiveness of pay incentives largely depends on how the worker perceives the system in relation to all of his needs both material and psychological.', 'Pay incentives are most effective when applied uniformly across all departments without consideration for individual performance.', 'Pay incentives are ineffective for employees who are intrinsically motivated and therefore should be avoided in all situations.', 'The success of pay incentives is solely dependent on the competitiveness of the industry.', 'Pay incentives always improve employee performance', 'Workers always trust the job analyst', 'Pay incentives are only effective when they are kept secret from the employees until after their performance is evaluated.', 'The effectiveness of pay incentives is guaranteed regardless of the organizational culture and employee engagement levels.']\",\"question\":\"Pay incentives are not always a feasible or effective way of improvingemployee performance or behavior. Discuss the limitingconditions for this program to be effective.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}