{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1f54b898-d11d-55b3-84a4-34ca73b80d0f","task_key":"default--test--2248","task_revision_id":"1","upstream_id":"2248","short_description":"What is autonomicconditioning ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Autonomic conditioning is a method of cognitive behavioral therapy targeting conscious thought patterns.', 'Autonomic conditioning involves the voluntary control of the muscles in the body.', 'Autonomic conditioning refers to the process of learning new behaviors', 'Autonomic conditioning is the practice of enhancing autonomic nervous system function through specific dietary changes.', 'Autonomic conditioning is a type of physical training', 'Autonomic conditioning refers to the acclimatization of the body to high-altitude environments.', 'Autonomic conditioning is related to memory formation', 'Autonomic conditioning refers to the operant conditioning of autonomic responses such as heart rate and intestinal contractions.']\",\"question\":\"What is autonomicconditioning ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}