{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6e57baa4-204b-50d9-804d-b94b67bb7d6b","task_key":"default--test--2418","task_revision_id":"1","upstream_id":"2418","short_description":"What do psychologists generally accept as the causes of functional psychoses?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Childhood experiences', 'Astrological signs and birth months', 'Educational background and intelligence quotient (IQ)', 'Exercise frequency and body mass index (BMI)', 'Use of technology and media consumption', 'Psychological trauma', 'Climate change and pollution levels', 'Hereditary factors, environmental factors, and biochemical factors are generally accepted as the causes of functional psychoses.', 'Dietary habits and sleep patterns', 'Lack of social interaction']\",\"question\":\"What do psychologists generally accept as the causes of functional psychoses?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}