{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。\n\nMMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex"},"task_id":"568ef878-3fde-5f11-82d4-cc745e178843","task_key":"standard~20~2810~20options~29--test--test~5fHistory~5f131","task_revision_id":"1","upstream_id":"test_History_131","short_description":"The data presented in the two tables (<image 1> and <image 2>) best support…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Tables']\",\"options\":\"['The education system was more developed in Viking England than in Tang China.', 'Elites in Tang China were less wealthy than elites in Viking England.', 'Viking England had a more extensive trade network than Tang China.', 'Tang coins were typically of greater value than coins in Viking England.', 'Merchants stood at the top of the social hierarchies in both Tang China and Viking England.', 'Coinage was seen as a useful means of storing value in both Tang China and Viking England.', 'Tang China had a more diverse economy than Viking England.', 'Tang China and Viking England had similar views on the importance of religion.', 'The societal structure in Viking England was more rigid than in Tang China.', 'Viking coins were typically of greater value than coins in Tang China.']\",\"question\":\"The data presented in the two tables (<image 1> and <image 2>) best support which of the following comparative statements about Tang China and Viking England?\",\"subject\":\"History\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:568ef878-3fde-5f11-82d4-cc745e178843:1:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""},{"kind":"file","reference_id":"task:568ef878-3fde-5f11-82d4-cc745e178843:1:image_2.png","filename":"image_2.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}