{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ee825a2-34c6-59cb-8ae1-a4e5644f5e0c","task_key":"standard~20~2810~20options~29--test--test~5fPublic~5fHealth~5f300","task_revision_id":"4","upstream_id":"test_Public_Health_300","short_description":"In 2005, Hunan Province monitored the source and incidence of haemorrhagic fever…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Tables']\",\"options\":\"['7.74%', '16.36%', '12.04%', '2.70%', '10.75%', '3.20%', '6.80%', '14.25%', '8.45%', '20.02%']\",\"question\":\"In 2005, Hunan Province monitored the source and incidence of haemorrhagic fever of renal syndrome in five counties (cities) under its jurisdiction. The following table showed the density and carriage of rodents at the monitoring sites.<image 1> The poison rate in Xiangtan County was\",\"subject\":\"Public_Health\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:7ee825a2-34c6-59cb-8ae1-a4e5644f5e0c:4:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}