{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。\n\nMMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex"},"task_id":"80d51ce9-89df-5cf2-b790-da2d0727824c","task_key":"standard~20~2810~20options~29--test--validation~5fPhysics~5f7","task_revision_id":"1","upstream_id":"validation_Physics_7","short_description":"<image 1> The elliptical orbit of a planet around the Sun is shown on the…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Diagrams', 'Geometric Shapes']\",\"options\":\"[\\\"the planet's orbit is a perfect circle\\\", 'the eccentricity of the orbit is greater than 1', 'the eccentricity of the orbit is equal to 1', 'the sun might be at point E', 'the sun might be at point C', 'the sun might be at point A', 'the eccentricity of the orbit is less thatn zero', 'the sun might be at point B', 'the sun might be at point D', 'the eccentricity of the orbit is zero']\",\"question\":\"<image 1> The elliptical orbit of a planet around the Sun is shown on the diagram. Which of the following statements is true?\",\"subject\":\"Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:80d51ce9-89df-5cf2-b790-da2d0727824c:1:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}