{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"847b4890-55b5-5b7d-a7c7-1438bbaafe82","task_key":"default--test--2239","task_revision_id":"1","upstream_id":"2239","short_description":"discuss these two points of view andgive evidence for both sides.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Perception develops independently of innate abilities and is entirely shaped by cultural influences.', 'The development of perception is a fixed process that remains constant across different environmental conditions.', 'Human perception is purely innate.', 'Perception is a learned skill that has no basis in biology or innate structures.', 'Perception only involves individual sensations coming together.', 'Perception is the result of a complex interplay between genetic predispositions and sensory experiences.', 'Perceptual abilities are determined solely by the immediate physical environment, with no influence from biology or past experiences.', 'Innate perceptual abilities are completely unchangeable and unaffected by learning or experience.', 'It is likely that we do have some innate perceptual abilities, and also that they can, to some extent, be modified by experience.', 'Perception is solely based on past experiences.']\",\"question\":\"discuss these two points of view andgive evidence for both sides.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}