{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9372e686-bf6d-53dd-8fd3-c573f6d3e453","task_key":"default--test--2189","task_revision_id":"1","upstream_id":"2189","short_description":"What is meant by the termconsciousness ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Consciousness is the storage of genetic information in cells.', 'Consciousness is the ability to think', 'Consciousness is the ability to talk to oneself', 'Consciousness is the exclusive ability to solve complex mathematical problems.', 'Consciousness is the biological process of breathing and heartbeat regulation.', 'Consciousness is solely the function of memory recall.', 'Consciousness is a state of wakefulness', 'Consciousness is the process by which the brain digests food.', 'Consciousness is the ability to perceive time.', 'Consciousness refers to the sum total of mental experiences.']\",\"question\":\"What is meant by the termconsciousness ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}