{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"608972dd-0680-50bc-84af-c41518ccc2e4","task_key":"standard~20~2810~20options~29--test--test~5fPharmacy~5f210","task_revision_id":"4","upstream_id":"test_Pharmacy_210","short_description":"Which of the following statements is true regarding the following chiral…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Chemical Structures']\",\"options\":\"['There is an asymmetric centre at the position labelled a)', 'There is an asymmetric centre at the position labelled b)', 'There is an asymmetric centre at the position labelled c)', 'There is an asymmetric centre at both positions labelled a) and b)', 'There is an asymmetric centre at both positions labelled b) and c)', 'There is an asymmetric centre at both positions labelled a) and c)', 'There is no asymmetric centre present']\",\"question\":\"Which of the following statements is true regarding the following chiral reducing agent <image 1>?\",\"subject\":\"Pharmacy\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:608972dd-0680-50bc-84af-c41518ccc2e4:4:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}