{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"d96cc171-02f8-5d77-a6bf-766c31ca0cf0","task_key":"standard~20~2810~20options~29--test--validation~5fPharmacy~5f27","task_revision_id":"3","upstream_id":"validation_Pharmacy_27","short_description":"The manufacture of compound F requires five separate chemical reactions. The…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Diagrams']\",\"options\":\"['50.0%,0.40 mol,0.05 mol,20.0%', '80.0%,0.50 mol,0.05 mol,20.0%', '40.0%,0.50 mol,0.05 mol,20.0%', '90.0%,0.50 mol,0.05 mol,20.0%', '50.0%,0.60 mol,0.05 mol,20.0%', '20.0%,0.50 mol,0.05 mol,20.0%', '60.0%,0.50 mol,0.05 mol,20.0%', '30.0%,0.50 mol,0.05 mol,20.0%', '70.0%,0.50 mol,0.05 mol,20.0%', '50.0%,0.50 mol,0.05 mol,20.0%']\",\"question\":\"The manufacture of compound F requires five separate chemical reactions. The initial reactant, compound A, is converted to compound B, compound B is converted to compound C, and so on. The diagram below summarizes the steps in the manufacture of compound F, including the percent yield for each step. Provide the missing quantities or missing percent yields.Assume that the reactant and product in each step react in a one-to-one mole ratio. <image 1>\",\"subject\":\"Pharmacy\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:d96cc171-02f8-5d77-a6bf-766c31ca0cf0:3:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}