{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5468ff04-236d-55b2-9860-00acc45a06c4","task_key":"default--test--2491","task_revision_id":"1","upstream_id":"2491","short_description":"How effective is punishment in eliminating unwanted behavior ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Punishment is most effective when it is delayed for a long period after the unwanted behavior', 'Only mild punishment is effective in eliminating unwanted behavior', 'Punishment is effective in eliminating unwanted behavior only when it is psychologically based', 'Punishment eliminates unwanted behavior if it is public and shaming', 'Punishment leads to the immediate and complete elimination of unwanted behavior without any side effects', 'Punishment can only eliminate unwanted behavior if it is physically painful', 'Punishment is ineffective in eliminating unwanted behavior', 'Punishment is effective in the elimination of undesirable behavior, particularly when intense and supplemented by the opportunity to learn new acceptable responses.', 'Punishment is only effective when applied inconsistently and without warning', 'Punishment causes a permanent change in behavior without the need for learning new responses']\",\"question\":\"How effective is punishment in eliminating unwanted behavior ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}