{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d68d884-bd0b-5d75-bcdd-59b16b7903c2","task_key":"standard~20~2810~20options~29--test--test~5fMarketing~5f86","task_revision_id":"4","upstream_id":"test_Marketing_86","short_description":"<image 1> Car manufacturers are interested in whether there is a relationship…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Tables']\",\"options\":\"['11', '6', '9', '10', '4', '12', '5', '7', '8', '3']\",\"question\":\"<image 1> Car manufacturers are interested in whether there is a relationship between the size of car an individual drives and the number of people in the driver's family (that is, whether car size and family size are independent). To test this, suppose that 800 car owners were randomly surveyed with the results in Table 11.39. df=______\",\"subject\":\"Marketing\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:5d68d884-bd0b-5d75-bcdd-59b16b7903c2:4:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}