{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b830cd0-7dd6-5099-9e53-99fcd7b1a7a1","task_key":"default--test--2651","task_revision_id":"1","upstream_id":"2651","short_description":"Expectancy theory predicts that worker motivation depends on several factors…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"the worker's beliefs about the potential negative outcomes of unsuccessful performance.\\\", 'the employee’s beliefs about the inherent (intrinsic) value of the work itself.', \\\"the worker's expectations about the probability of success.\\\", 'the employee’s beliefs about the value of rewards provided for successful performance.', \\\"the worker's perceived ability to perform the task successfully.\\\", \\\"the duration of the worker's tenure at the organization.\\\", \\\"the strength of the worker's motivation and organizational commitment.\\\", \\\"the worker's beliefs about the fairness of the reward system.\\\", 'the strength of the effort (versus ability) component of the worker’s motivation.', \\\"the worker's level of satisfaction with the organizational culture.\\\"]\",\"question\":\"Expectancy theory predicts that worker motivation depends on several factors including “valence,” which refers to:\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}