{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"9acd2645-8842-5609-b4d5-ac056e3a0e02","task_key":"standard~20~2810~20options~29--test--test~5fArt~5fTheory~5f117","task_revision_id":"3","upstream_id":"test_Art_Theory_117","short_description":"What attitude toward nature do these two works exhibit? <image 1> <image 2>","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Photographs']\",\"options\":\"['Scientific analyses of nature in the left work and subservience to nature in the right work', 'Exaltation of nature in both works', 'Scientific analyses of nature in both works', 'Subservience to nature in both works', 'Harmony with nature in the left work and conquest of nature in the right work', 'Fear of nature in both works', 'Subservience to nature in the left work and fear of nature in the right work', 'Exaltation of nature in the left work and fear of nature in the right work', 'Fear of nature in the left work and exaltation of nature in the right work', 'Conquest of nature in the left work and harmony with nature in the right work']\",\"question\":\"What attitude toward nature do these two works exhibit? <image 1> <image 2>\",\"subject\":\"Art_Theory\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:9acd2645-8842-5609-b4d5-ac056e3a0e02:3:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""},{"kind":"file","reference_id":"task:9acd2645-8842-5609-b4d5-ac056e3a0e02:3:image_2.png","filename":"image_2.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}