{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。\n\nMMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex"},"task_id":"8aae1bd5-eef5-5fc7-bf40-725f15ee2b38","task_key":"standard~20~2810~20options~29--test--test~5fHistory~5f168","task_revision_id":"1","upstream_id":"test_History_168","short_description":"<image 1> Which of the following historical developments is most strongly…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Maps']\",\"options\":\"['The decline of the Byzantine Empire led to the decline of trade networks in Afro-Eurasia', 'The development of new maritime technology expanded the spread of innovations between cultures', 'The rise of the Han dynasty expanded the spread of innovations between cultures', 'Use of the Silk Road across the Asian continent declined as trans-Saharan trade routes rose in prominence', 'The fall of the Roman Empire led to the rise of trade networks in Afro-Eurasia', \\\"Timbuktu's influence sharply declined after Mansa Musa returned from his journey to Mecca\\\", 'The influence of the Persian Empire expanded the spread of innovations between cultures', 'The rise of the Ottoman Empire led to the decline of trade networks in Afro-Eurasia', 'The Mongol Empire contributed to the decline of trade networks in Afro-Eurasia', 'The wealth generated by the Empire of Mali contributed to trade networks in Afro-Eurasia']\",\"question\":\"<image 1> Which of the following historical developments is most strongly illustrated in Map 1?\",\"subject\":\"History\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:8aae1bd5-eef5-5fc7-bf40-725f15ee2b38:1:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}