{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fadf606c-430d-5c67-a889-795a34d9dc6d","task_key":"default--test--2181","task_revision_id":"1","upstream_id":"2181","short_description":"How does Helmholtz's rule explainillusions ?How does it accountfor our…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"Helmholtz's rule explains illusions as incorrectly applied constancies and helps interpret our feelings based on 'most likely' causes.\\\", \\\"Helmholtz's rule relates illusions to the brain's inability to properly process conflicting information from different senses.\\\", \\\"Helmholtz's rule implies that illusions occur due to a temporary malfunction in the visual system.\\\", \\\"Helmholtz's rule interprets our feelings based on immediate causes\\\", \\\"Helmholtz's rule asserts that illusions are caused by the brain's misinterpretation of sensory stimuli based on past experiences.\\\", \\\"Helmholtz's rule explains illusions as optical errors\\\", \\\"Helmholtz's rule attributes illusions to a failure of depth perception.\\\", \\\"Helmholtz's rule explains illusions as visual distortions\\\", \\\"Helmholtz's rule explains illusions as a disruption in the brain's pattern recognition processes.\\\", \\\"Helmholtz's rule suggests illusions are the result of unconscious inferences that can be overridden by conscious thought.\\\"]\",\"question\":\"How does Helmholtz's rule explainillusions ?How does it accountfor our interpretation of our own feelings ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}