{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ace50f2-839c-5526-9d90-427ebaa0976a","task_key":"default--test--2233","task_revision_id":"1","upstream_id":"2233","short_description":"Discuss some criticisms of Freud's theory.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Disregarding genetic factors in personality development', 'Ignoring the role of the prefrontal cortex in behavior and decision-making', 'Overemphasis on individual experiences', 'Views on sex, the unconscious, and early childhood experience; methods of patient treatment; lengthy and costly process of psychoanalysis', 'Overreliance on the concept of the Oedipus complex', \\\"Overinterpretation of symbolism in patient's communications\\\", 'Excessive focus on the role of dreams in understanding the psyche']\",\"question\":\"Discuss some criticisms of Freud's theory.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}