{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b96dba07-8ab0-5fe7-840c-2448b0fe959c","task_key":"default--test--3313","task_revision_id":"1","upstream_id":"3313","short_description":"Discuss the role of a stimulus that elicits a behavior pattern.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"[\\\"The intensity of the stimuli necessary to evoke a behavior is directly proportional to the animal's motivation\\\", 'Only stimuli of a social nature can elicit behavior patterns in animals', 'Behavior patterns are random and not specifically elicited by any particular stimuli', 'A stimulus always requires conscious recognition by the animal to elicit a behavior pattern', 'All stimuli can elicit specific behavior patterns', \\\"A stimulus elicits a behavior pattern based solely on the physical strength of the stimulus, regardless of the animal's internal state\\\", \\\"Sign stimuli elicit specific responses from an animal and the intensity of the stimuli necessary to evoke a behavior pattern is inversely proportional to the animal's motivation to perform that behavior.\\\", 'Sign stimuli suppress specific responses in an animal', 'The frequency of a stimulus rather than its intensity determines the likelihood of eliciting a behavior pattern', 'Stimuli that elicit behavior patterns are only effective in the presence of other, secondary stimuli']\",\"question\":\"Discuss the role of a stimulus that elicits a behavior pattern.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}