{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5207e37e-7025-5d49-acd4-79079a98f6d2","task_key":"default--test--2911","task_revision_id":"1","upstream_id":"2911","short_description":"Discuss the role of a stimulus that elicits a behavior pattern.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Stimuli can only elicit a response if they are intense', \\\"Stimuli intensity directly affects the animal's motivation\\\", \\\"Stimuli have no influence on an animal's behavior\\\", 'Stimuli serve as a universal language, eliciting the same behavior patterns across different species.', \\\"Stimuli, referred to as sign stimuli, elicit specific responses from an animal. The intensity of the stimuli necessary to evoke a behavior pattern is inversely proportional to the animal's motivation to perform that behavior.\\\", 'Stimuli are only effective if they are novel and unfamiliar to the animal.', 'Stimuli that elicit behavior patterns are only visual; other sensory modalities do not trigger responses.', 'Stimuli are passive elements in the environment and require the animal to interpret them before eliciting a behavior pattern.', \\\"The animal's motivation to perform a behavior has no impact on how stimuli affect behavior patterns.\\\", 'Stimuli must be paired with a reward to elicit any behavior pattern.']\",\"question\":\"Discuss the role of a stimulus that elicits a behavior pattern.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}