{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"78e7f774-93d1-5f61-bff5-8a306b9871d6","task_key":"default--test--2737","task_revision_id":"1","upstream_id":"2737","short_description":"Describe a backward conditioning procedure. What is the usualeffect of this kind…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Backward conditioning results in the conditioned stimulus becoming irrelevant.', 'Backward conditioning is the same as forward conditioning in terms of effectiveness.', 'Backward conditioning has no impact on the response to the conditioned stimulus.', 'Backward conditioning strengthens the response to the conditioned stimulus.', 'Backward conditioning weakens the unconditioned response.', 'Backward conditioning usually results in inhibitory conditioning.', 'Backward conditioning is highly effective.', 'Backward conditioning usually leads to excitatory conditioning.', 'Backward conditioning is a procedure where the conditioned stimulus is presented long after the unconditioned stimulus.', \\\"Backward conditioning enhances the unconditioned stimulus's effect without involving the conditioned stimulus.\\\"]\",\"question\":\"Describe a backward conditioning procedure. What is the usualeffect of this kind of conditioning ? Include an explanationof inhibitory conditioning.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}