{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6a49828e-0cdd-5194-901a-98129076054d","task_key":"default--test--2489","task_revision_id":"1","upstream_id":"2489","short_description":"Discuss the role of attitudes and expectancy in attention.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Attitudes and expectancy are only relevant in the initial stages of attention.', 'Attitudes and expectancy only affect long-term memory.', 'Attitudes and expectancy alter the intensity of stimuli required to capture attention.', 'Attitudes and expectancy only affect attention during high-stress situations.', 'Attitudes and expectancy affect attention by increasing the speed of cognitive processing for all types of information.', 'Attitudes and expectancy only influence our perception of size and duration.', 'Attitudes and expectancy change the sensory modalities we pay attention to.', 'Attitudes and expectancy guide the focus of attention by making relevant information salient and excluding other information.', 'Attitudes and expectancy primarily determine the accuracy of our visual attention.', 'Attitudes and expectancy have no effect on attention.']\",\"question\":\"Discuss the role of attitudes and expectancy in attention.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}