{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8c2dcbaf-3733-53d8-91fb-76304fb174d7","task_key":"default--test--3343","task_revision_id":"1","upstream_id":"3343","short_description":"What is behavior? Are behavior patterns solely inherited or canthey be modified?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Behavior patterns cannot be modified', 'Behavior is limited to the animal kingdom', 'Behavior is a random set of actions without any pattern or predictability', 'Behavior patterns are determined exclusively by environmental factors without any genetic influence', 'Behavior patterns are solely determined by immediate stimuli and are not influenced by past experiences', \\\"Behavior patterns are fixed at birth and remain unchanged throughout an individual's life\\\", 'Behavior is an exclusively human trait not found in other animals', 'Behavior is only learned through imitation and cannot be innate', 'Both inheritance and learning are fundamental in the determination of behavioral patterns', 'Behavior patterns are solely inherited']\",\"question\":\"What is behavior? Are behavior patterns solely inherited or canthey be modified?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}