{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6ef8928b-0ab3-546b-9554-c1587a0bf2ac","task_key":"default--test--3320","task_revision_id":"1","upstream_id":"3320","short_description":"Explain how a \"Skinner box\" can be used in operant conditioning.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Skinner box automatically trains animals to perform complex tasks without reinforcement', 'Skinner box is a tool for enhancing the cognitive abilities of animals through exposure to various puzzles', 'Skinner box is used for memory exercises', 'Skinner box is used in operant conditioning to reward or punish a behavior, thereby increasing or decreasing the probability of its occurrence.', 'Skinner box is a punishment device', 'Skinner box is a tool for sensory deprivation', 'Skinner box is primarily used for classical conditioning involving involuntary behaviors', 'Skinner box is designed to study the natural habitat behaviors of animals', 'Skinner box is a device that measures the intelligence quotient (IQ) of animals', 'Skinner box is used to observe the effects of different drugs on behavior without any reinforcement contingencies']\",\"question\":\"Explain how a \\\"Skinner box\\\" can be used in operant conditioning.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}