{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"a795128a-5533-5fb6-98b8-557e9491b4cb","task_key":"standard~20~2810~20options~29--test--test~5fSociology~5f140","task_revision_id":"3","upstream_id":"test_Sociology_140","short_description":"What is <image 1>?","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Comics and Cartoons']\",\"options\":\"['The tendency to conform to social norms', 'The process by which individuals learn and adopt the values and behaviors of their culture', 'Refers to the process of self development through which we formulate a unique sense of ourselves and our relationship to the world around us', 'The learning of gender roles begins at birth', 'A process of socialization that involves adjusting and adapting to societal norms and expectations', 'Rewards and punishments that can be given by most members of a group', \\\"The process of learning about and accepting the standards and norms of one's society or culture\\\", 'The process by which people learn the characteristics of their group', 'A method that is useful for gathering less detailed information from a larger group.', 'The process through which we learn and internalize the attitudes, roles, expectations, and cultural norms of society']\",\"question\":\"What is <image 1>?\",\"subject\":\"Sociology\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:a795128a-5533-5fb6-98b8-557e9491b4cb:3:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}