{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5192d6cd-f912-5405-928f-882d2e5b9e8b","task_key":"default--test--2552","task_revision_id":"1","upstream_id":"2552","short_description":"What is the difference between consciousness and awareness ?Define automatic…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Automatic behavior refers to actions that are performed with a high level of emotional engagement.', 'Automatic behavior refers to any behavior that can be engaged in without much concentration and effort.', 'Automatic behavior refers to activities that can only be performed while in a state of deep meditation.', 'Automatic behavior is a subconscious response to stimuli.', 'Automatic behavior requires full concentration and effort.', 'Automatic behavior is a random response to stimuli that occurs without any prior learning or experience.', 'Automatic behavior is a term used to describe the involuntary physiological processes of the body, such as heartbeat and digestion.', 'Automatic behavior is a learned response that requires deliberate planning and thought each time it is performed.', 'Automatic behavior is the same as conscious behavior and requires awareness.', 'Automatic behavior refers to actions that require full awareness.']\",\"question\":\"What is the difference between consciousness and awareness ?Define automatic behavior.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}