{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"9cbf95ff-e475-5334-a954-72107fd5b2d1","task_key":"standard~20~2810~20options~29--test--test~5fHistory~5f134","task_revision_id":"3","upstream_id":"test_History_134","short_description":"The conflict addressed in the <image 1> is best understood in the context of…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Sketches and Drafts']\",\"options\":\"['The imperial interests of the United States', 'The environmental conservation movement', 'The rise of digital technology', 'A stagnation in global trade', 'The advancement of space exploration', 'The burgeoning human rights movement', 'The explosion in global population', 'The decline in religious influence', 'The shift towards renewable energy', 'A dramatic increase in migration']\",\"question\":\"The conflict addressed in the <image 1> is best understood in the context of which of the following?\",\"subject\":\"History\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:9cbf95ff-e475-5334-a954-72107fd5b2d1:3:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}