{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4332813b-c18f-51e5-ba35-25d5f5c11bf5","task_key":"standard~20~2810~20options~29--test--test~5fMath~5f270","task_revision_id":"4","upstream_id":"test_Math_270","short_description":"A ladder 20 feet long is leaning against a wall 12 feet high with its top…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Diagrams']\",\"options\":\"['2.7 feet per minute', '2.2 feet per minute', '2.1 feet per minute', '3.1 feet per minute', '2.4 feet per minute', '3.4 feet per minute', '2.9 feet per minute', '2.8 feet per minute', '3.2 feet per minute', '2.6 feet per minute']\",\"question\":\"A ladder 20 feet long is leaning against a wall 12 feet high with its top projecting over the wall (Fig. 14-16). Its bottom is being pulled away from the wall at the constant rate of 5 ft/min. How rapidly is the height of the top of the ladder decreasing when the top of the ladder reaches the top of the wall?<image 1>\",\"subject\":\"Math\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:4332813b-c18f-51e5-ba35-25d5f5c11bf5:4:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}