{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。\n\nMMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex"},"task_id":"7c690cac-56b5-5217-8122-d4211502c20b","task_key":"standard~20~2810~20options~29--test--test~5fSociology~5f176","task_revision_id":"1","upstream_id":"test_Sociology_176","short_description":"What is the <image 1>?","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Diagrams']\",\"options\":\"[\\\"The intrinsic qualities that define an individual's character and individuality\\\", 'A theory that uses the concept of gender, class, and race to study and challenge power and inequality', \\\"The social and psychological processes that shape one's sense of self\\\", 'Identity is regarded as the result of modeling oneself in response to the expectations of others, not as a produc4 of the unconscious', \\\"The concept of self that is shaped by the individual's personal experiences and interactions with others.\\\", 'A sense of self that is influenced by cultural and societal norms and expectations', 'Socially deLned expectations that a person in a given social position will follow', \\\"The development of one's self-concept through interactions with others in a social context\\\", 'Refers to the process of self development through which we formulate a unique sense of ourselves and our relationship to the world around us', \\\"The collective cultural values and norms that influence an individual's behavior and self-perception\\\"]\",\"question\":\"What is the <image 1>?\",\"subject\":\"Sociology\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:7c690cac-56b5-5217-8122-d4211502c20b:1:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}