{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。\n\nMMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex"},"task_id":"7176be57-a9f1-54aa-833b-79caf1f2ce7f","task_key":"standard~20~2810~20options~29--test--test~5fClinical~5fMedicine~5f131","task_revision_id":"1","upstream_id":"test_Clinical_Medicine_131","short_description":"The following film shows an example of what? <image 1>","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Microscopic Images']\",\"options\":\"['Splashes of developer on the film prior to processing', 'Scratches on the film prior to processing', 'Dust particles on the film during processing', 'Splashes of rinse on the film prior to processing', 'Residue from the film after processing', 'Splashes of fixer on the film prior to processing', 'Overexposure of the film during processing', 'Splashes of water on the film prior to processing', 'Light leaks on the film during processing', 'Air bubbles on the film during processing']\",\"question\":\"The following film shows an example of what? <image 1>\",\"subject\":\"Clinical_Medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:7176be57-a9f1-54aa-833b-79caf1f2ce7f:1:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}