{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。\n\nMMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex"},"task_id":"4332813b-c18f-51e5-ba35-25d5f5c11bf5","task_key":"standard~20~2810~20options~29--test--test~5fMath~5f270","task_revision_id":"1","upstream_id":"test_Math_270","short_description":"A ladder 20 feet long is leaning against a wall 12 feet high with its top…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Diagrams']\",\"options\":\"['2.7 feet per minute', '2.2 feet per minute', '2.1 feet per minute', '3.1 feet per minute', '2.4 feet per minute', '3.4 feet per minute', '2.9 feet per minute', '2.8 feet per minute', '3.2 feet per minute', '2.6 feet per minute']\",\"question\":\"A ladder 20 feet long is leaning against a wall 12 feet high with its top projecting over the wall (Fig. 14-16). Its bottom is being pulled away from the wall at the constant rate of 5 ft/min. How rapidly is the height of the top of the ladder decreasing when the top of the ladder reaches the top of the wall?<image 1>\",\"subject\":\"Math\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:4332813b-c18f-51e5-ba35-25d5f5c11bf5:1:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}