{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"195285c1-b8ed-55ba-b4f9-1bbd9e4a038e","task_key":"default--test--2667","task_revision_id":"1","upstream_id":"2667","short_description":"What is the major difference between negative reinforcement and punishment?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Punishments are used to reward a behavior, and negative reinforcements are used to deter a behavior.', 'Negative reinforcements are used in classical conditioning, and punishments are used in operant conditioning.', 'Punishments are used to reinforce positive behaviors, while negative reinforcements are used to discourage negative behaviors.', 'Negative reinforcements are used to decrease the frequency of a behavior, and punishments increase the frequency of a behavior.', 'Punishments involve the removal of a positive stimulus, while negative reinforcements involve the addition of a negative stimulus.', 'Punishments are used with nonhuman animals, and negative reinforcements are used with humans.', 'Negative reinforcements are used to suppress the frequency of a behavior, while punishments are used to promote the frequency of a behavior.', 'Punishments are primarily used when training an organism to perform a behavior and negative reinforcements are used to train an organism to stop performing a behavior.', 'Negative reinforcements are always physical, and punishments are always psychological.', 'Punishments decrease the frequency of a behavior and negative reinforcements increase the frequency of a behavior.']\",\"question\":\"What is the major difference between negative reinforcement and punishment?\",\"src\":\"ori_mmlu-high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}