{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"9ca6ab5d-a316-54e8-a536-cf7c137a0493","task_key":"standard~20~2810~20options~29--test--test~5fDesign~5f72","task_revision_id":"3","upstream_id":"test_Design_72","short_description":"The sculpture (<image 1>) shown can be attributed to the same culture that…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Sculpture']\",\"options\":\"['Moai from Easter Island', 'sculpture of Apollo from the Etruscan temple at Veii', 'statue of David by Michelangelo from Florence', 'Discobolus of Myron from Athens', 'votive figures from the Sumerian Square Temple at Eshnunna', 'Terracotta Army from the tomb of Emperor Qin Shi Huang', 'seated scribe from the Egyptian tomb at Saqqara', 'statue of Zeus from Olympia', 'the mask of Tutankhamun from his tomb in the Valley of the Kings', 'Peplos Kore from the Acropolis in Athens']\",\"question\":\"The sculpture (<image 1>) shown can be attributed to the same culture that produced the .\",\"subject\":\"Design\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:9ca6ab5d-a316-54e8-a536-cf7c137a0493:3:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}