{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。\n\nMMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex"},"task_id":"2b6aefa7-968c-5ba5-82cf-31d003867c7e","task_key":"standard~20~2810~20options~29--test--test~5fHistory~5f8","task_revision_id":"1","upstream_id":"test_History_8","short_description":"<image 1> The conflict referred to in the image was a result of which of the…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Poster']\",\"options\":\"['The start of the Cold War', 'The establishment of the League of Nations', 'The creation of the United Nations', 'The rise of the United States and the Soviet Union as superpowers', 'The end of colonial rule in Africa and Asia', 'The collapse of the land-based Ottoman and Qing empires', 'The global economic crisis caused by the Great Depression', 'The widespread use of nuclear weapons', 'The complete dissolution of European transoceanic empires', 'The spread of communism in Eastern Europe']\",\"question\":\"<image 1> The conflict referred to in the image was a result of which of the following developments in the first half of the twentieth century?\",\"subject\":\"History\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:2b6aefa7-968c-5ba5-82cf-31d003867c7e:1:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}