{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"628ecbd0-4e4a-5cdc-b868-ff8a6d99f8df","task_key":"default--test--2487","task_revision_id":"1","upstream_id":"2487","short_description":"Discuss the theoretical problem of pattern recognition. Why is it an important…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Pattern recognition is a complex process where the human information processing system selects the central similarity from many visual configurations, which makes it difficult to explain.', 'Pattern recognition is solely the function of the occipital lobe in the brain, without involvement of other brain regions.', 'Pattern recognition is a deterministic process that follows a strict set of rules applicable to all visual stimuli.', 'Pattern recognition involves drawing a neurological map of the processes from sensation to reaction', 'Pattern recognition is the process of recognizing and responding to stimuli', 'Pattern recognition is the ability to store images in memory for future reference without any cognitive processing.', 'Pattern recognition relies exclusively on past experiences and does not require any form of in-the-moment analysis or decision-making.', 'Pattern recognition is not relevant to information processing theory as it does not influence cognitive tasks.', 'Pattern recognition is simple because it occurs quickly and with ease', 'Pattern recognition is the process of matching sounds to their corresponding visual representations.']\",\"question\":\"Discuss the theoretical problem of pattern recognition. Why is it an important dimension of information processing theory?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}