{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eca547af-d54f-582f-8bd9-2e5fbc3ae379","task_key":"default--test--2120","task_revision_id":"1","upstream_id":"2120","short_description":"What is the relationship between the genetic factor and the environmental factor…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Intelligence is solely determined by environmental factors', 'Intelligence is solely determined by genetic factors', 'Intelligence fluctuates significantly throughout life, independent of genetic or environmental stability', 'Intelligence is not affected by either genetic or environmental factors', 'Intelligence is determined at birth and remains constant throughout life, regardless of genetics or environment', 'Intelligence is determined by both genetic and environmental factors', 'Intelligence is determined by social factors, with genetics playing a secondary role', 'Intelligence is the result of a complex interplay between genetic factors and life experiences, with environmental factors being less significant', 'Intelligence is primarily determined by educational factors, with minimal influence from genetics or environment', 'Intelligence is determined by a balance of genetic factors, environmental factors, and random chance events']\",\"question\":\"What is the relationship between the genetic factor and the environmental factor in intelligence?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}