{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"44de2ef4-1bcd-5663-8ea2-4a740d84b27c","task_key":"default--test--2736","task_revision_id":"1","upstream_id":"2736","short_description":"What is a conversionreaction ?What are thepsychoanalytic andbehavioral theories…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Conversion reactions are solely physiological responses to stress with no psychological basis.', \\\"Conversion reactions are related to the individual's innate fear response.\\\", 'Conversion reactions are physiological disorders caused by physical trauma.', 'Conversion reactions are impairments of the musculature or sensory functions without any physiological causes, rooted in unresolved Oedipus or Electra complex according to psychoanalytic theory, or imitated behavior according to behavioral theory.', 'Conversion reactions are conscious attempts to manipulate others and are not genuinely experienced by the individual.', 'Conversion reactions are the result of genetic predispositions and have no connection to past experiences.', 'Conversion reactions are typical developmental stages that every individual goes through and resolve on their own without intervention.', 'Conversion reactions are mental disorders with no grounding in psychoanalytic or behavioral theories.', 'Conversion reactions are caused by chemical imbalances in the brain and are not influenced by psychological factors.', 'Conversion reactions are a form of attention-seeking behavior with no underlying psychological conflict.']\",\"question\":\"What is a conversionreaction ?What are thepsychoanalytic andbehavioral theories explaining this disorder?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}