{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1c4b5ba1-55cb-5d48-bc9c-627b6a72a29c","task_key":"default--test--2488","task_revision_id":"1","upstream_id":"2488","short_description":"Describe the McCollough Effect. How does it support, the theorythat there are…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['The McCollough Effect suggests that color and line detection are processed in separate, independent areas of the brain', 'The McCollough Effect reveals that color detection is influenced by motion detectors, not colored-line detectors', 'The McCollough Effect has nothing to do with colored-line detectors', 'The McCollough Effect indicates that color perception is solely dependent on context and lighting', 'The McCollough Effect demonstrates the existence of two complementary systems sensitive to certain colors, providing evidence for the colored-line detectors theory.', 'The McCollough Effect shows a temporal change in color perception, unrelated to any detectors', 'The McCollough Effect is an auditory phenomenon that does not involve color or line detection', 'The McCollough Effect proves the existence of only one system sensitive to color', 'The McCollough Effect supports the theory that color perception is a learned response with no specific detectors involved', 'The McCollough Effect disproves the existence of colored-line detectors']\",\"question\":\"Describe the McCollough Effect. How does it support, the theorythat there are colored-line detectors in the human system ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}