{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a2d1554-b4a5-5b57-bd3f-bad74ec7a61f","task_key":"standard~20~2810~20options~29--test--validation~5fPharmacy~5f1","task_revision_id":"4","upstream_id":"validation_Pharmacy_1","short_description":"Ammonia reacts with oxygen to yield nitrogen and water,<image 1>,Given this…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Mathematical Notations', 'Chemical Structures']\",\"options\":\"['6.0 mol of NH3, 2.0 mol of N2, 7.0 mol of H2O', '4.0 mol of NH3,2.0 mol of N2,6.0 mol of H2O', '4.0 mol of NH3,1.0 mol of N2,6.0 mol of H2O', '4.0 mol of NH3, 1.0 mol of N2, 5.0 mol of H2O', '4.0 mol of NH3, 3.0 mol of N2, 8.0 mol of H2O', '2.0 mol of NH3, 1.0 mol of N2, 4.0 mol of H2O', '5.0 mol of NH3, 2.0 mol of N2, 7.0 mol of H2O', '3.0 mol of NH3, 2.0 mol of N2, 5.0 mol of H2O', '4.0 mol of NH3,3.0 mol of N2,6.0 mol of H2O']\",\"question\":\"Ammonia reacts with oxygen to yield nitrogen and water,<image 1>,Given this chemical equation, as well as the number of moles of the reactant or product indicated below, determine the number of moles of all remaining reactants and products:. 3.0 mol O2\",\"subject\":\"Pharmacy\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:2a2d1554-b4a5-5b57-bd3f-bad74ec7a61f:4:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}