{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"e8dbc861-8bf3-5037-ba20-7ece2e990da1","task_key":"standard~20~2810~20options~29--test--test~5fAccounting~5f279","task_revision_id":"3","upstream_id":"test_Accounting_279","short_description":"<image 1> Hicks Products produces and sells patio furniture through a national…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Tables']\",\"options\":\"['$1,484,000', '$484,000', '$3,616,000', '$3,474,000', '$2,800,000', '$1,616,000', '$4,100,000', '$2,616,000', '$2,474,000', '$3,100,000']\",\"question\":\"<image 1> Hicks Products produces and sells patio furniture through a national dealership network. They purchase raw materials from a variety of suppliers and all manufacturing, and assembly work is performed at their plant outside of Cleveland, Ohio. They recorded these costs for the year ending December 31, 2017. What is the net income?\",\"subject\":\"Accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:e8dbc861-8bf3-5037-ba20-7ece2e990da1:3:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}