{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"923bed81-a0a1-5b04-9ec7-22abfe64535d","task_key":"standard~20~2810~20options~29--test--test~5fMusic~5f293","task_revision_id":"2","upstream_id":"test_Music_293","short_description":"<image 1> [Harmony] In the music excerpt shown above, the modality of the…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Sheet Music']\",\"options\":\"['Melodic minor; Natural minor; Harmonic minor', 'Harmonic minor; Melodic major; Natural minor', 'Harmonic major; Melodic minor; Natural major', 'Harmonic minor; Natural major; Harmonic major', 'Natural minor; Harmonic minor; Natural minor', 'Natural major; Harmonic minor; Melodic major', 'Harmonic major; Natural minor; Melodic minor', 'Natural minor; Harmonic major; Melodic minor', 'Melodic minor; Natural major; Harmonic major', 'Melodic minor; Harmonic major; Natural major']\",\"question\":\"<image 1> [Harmony] In the music excerpt shown above, the modality of the melodic part in the first two measures of the 4th line is (), and in the last two beats of the 1st measure of the 5th line, the bass part uses the modality alternation technique from () to ().\",\"subject\":\"Music\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:923bed81-a0a1-5b04-9ec7-22abfe64535d:2:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}