{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"f611d1a2-4adf-5e01-b0aa-0327822ad6c2","task_key":"standard~20~2810~20options~29--test--test~5fHistory~5f138","task_revision_id":"3","upstream_id":"test_History_138","short_description":"The object in <image 1>best illustrates which of the following patterns in world…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Photographs']\",\"options\":\"['Governments used religious imagery to suppress rebellion.', 'Rulers used religious imagery to enhance their political standing.', 'The success of states was measured by their architectural innovations.', 'Governments used art to distract from political issues.', 'Rulers used scientific advancements to assert dominance.', 'Rulers used art to glorify themselves.', 'The power of states was based on the ability of rulers to control religion.', 'Rulers used art to communicate with the divine.', 'The wealth of states was determined by their artistic productions.', 'Governments used art and architecture as propaganda.']\",\"question\":\"The object in  <image 1>best illustrates which of the following patterns in world history?\",\"subject\":\"History\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:f611d1a2-4adf-5e01-b0aa-0327822ad6c2:3:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}