{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。\n\nMMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex"},"task_id":"3772ac24-c612-5329-b871-5271aa62ae82","task_key":"standard~20~2810~20options~29--test--test~5fHistory~5f170","task_revision_id":"1","upstream_id":"test_History_170","short_description":"<image 1> Which of the following best describes the causal link between the…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Paintings']\",\"options\":\"[\\\"The Seven Years' War led to a shift in British foreign policy, with the Crown seeking to establish tighter control over its colonies, leading to tension and eventual conflict.\\\", \\\"Emboldened by their victories during the Seven Years' War, colonial elites challenged the Crown, pushing for independence before the working-class populace was ready to accept it.\\\", \\\"The Seven Years' War weakened the British military, leaving the Thirteen Colonies vulnerable to foreign invasion and prompting colonists to consider independence.\\\", \\\"Disillusioned by their experiences in the Seven Years' War, colonial militia members formed the Sons of Liberty, a radical group calling for independence from the Crown.\\\", \\\"Veterans of the Seven Years' War played key roles in the Revolutionary War, using their military experience to lead colonial forces against the Crown.\\\", \\\"The Seven Years' War led to a change in British leadership, with the new government adopting harsher policies towards the Thirteen Colonies, sparking resentment among colonists.\\\", \\\"The Seven Years' War led to the implementation of the Stamp Act, which was met with widespread resistance and became a catalyst for the Revolutionary War.\\\", \\\"Britain's defeat after the Seven Years' War led to massive debt for the Crown, prompting an effort to collect taxes from the Thirteen Colonies.\\\", \\\"The Seven Years' War disrupted trade between the Thirteen Colonies and Europe, leading to economic instability and growing discontent with British rule.\\\", \\\"Britain's massive debt after the Seven Years' War resulted in a push for greater control over the Thirteen Colonies, sparking debate among colonists over the pursuit of independence.\\\"]\",\"question\":\"<image 1> Which of the following best describes the causal link between the Seven Years' War and the Revolutionary War?\",\"subject\":\"History\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:3772ac24-c612-5329-b871-5271aa62ae82:1:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}