Benchmark AI / Public workspace
MMMU-Pro
Multimodal
MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.
Japanese introduction
多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。
mmmu-pro
Full text: eligible public problems include text, images and discussion.
Tasks
Whole public benchmark.
- Public problems
- 200
- Formats
- text (200)
- Problems with images
- 240
- Answer availability
- Answer published by the source (200)
- Configs
- standard (10 options) (200)
- Splits
- test (200)
- Awaiting a first discussion
- 200
- Assuming the following account balance changes for the period, what is the… Image attached
Answer published by the source
- <image 1> Which nutrient seems to be absent given the signs of deficiency in… Image attached
Answer published by the source
- Use an approximate analysis of the continuous truss in Figure P13.11 to evaluate… Image attached
Answer published by the source
- <image 1> is called? Image attached
Answer published by the source
- <image 1> It was likely this building used which of the following architectural… Image attached
Answer published by the source
- Which of the following is the lowest level at which BINAURAL input to the same… Image attached
Answer published by the source
- Where is the myelin sheath in <image 1>? Image attached
Answer published by the source
- Name the most likely mode of inheritance in the following pedigree: <image 1> Image attached
Answer published by the source
- The patient shown below most likely has which of the following? <image 1> Image attached
Answer published by the source
- <image 1> Is it a NFA? Image attached
Answer published by the source
- Which figure represents the many-to-many thread model? Image attached
Answer published by the source
- You have a 1-D dataset large {x^{(1)}, ... , x^{(m)} } and you want to… Image attached
Answer published by the source
- The showroom was designed by who?<image 1> Image attached
Answer published by the source
- Diagnosis? <image 1> Image attached
Answer published by the source
- The market for pizza has the following demand and supply schedules:<image 1>… Image attached
Answer published by the source
- Using superposition and Laplace transform techniques, calculate the voltage… Image attached
Answer published by the source
- Which of the following best explains the overall trend shown in the <image 1>? Image attached
Answer published by the source
- <image 1> Which of the following best describes the causal link between the… Image attached
Answer published by the source
- <image 1> The conflict referred to in the image was a result of which of the… Image attached
Answer published by the source
- <image 1> shows the results from looking at the diagnostic accuracy of a new… Image attached
Answer published by the source
- A study was set up to look at counts of CD4+ T helper cells in a group of 17… Image attached
Answer published by the source
- A ladder 20 feet long is leaning against a wall 12 feet high with its top… Image attached
Answer published by the source
- Select the correct main view in the following figure. ().<image 1> Image attached
Answer published by the source
- The Iron Arms rotating forearm grips exercises the forearms by resisting… Image attached
Answer published by the source
- There are three mechanisms for the phosphorylation of ADP to produce ATP. Write… Image attached
Answer published by the source
- Fill in the following table (b)(d)(f)(h) with the energy source of each type of… Image attached
Answer published by the source
- Researchers studying vision use various methods to investigate human perceptual… Image attached
Answer published by the source
- In order to study the relationship between drinking alcohol and hypertension, a… Image attached
Answer published by the source
- In March 2009, an outbreak of Influenza A (H1N1) occurred somewhere in Mexico… Image attached
Answer published by the source
- Sociologists using <image 1> perspective might study what? Image attached
Answer published by the source
- Baghdad Company produces a single product. They have recently received the… Image attached
Answer published by the source
- The following data show the units in beginning work in process inventory, the… Image attached
Answer published by the source
- <image 1> The architect's philosophy of building is expressed by the idea that Image attached
Answer published by the source
- What is this structure? <image 1> Image attached
Answer published by the source
- Consider the diagram in <image 1> regarding a mountainous region. The diagram… Image attached
Answer published by the source
- Reto Zach studied the whelk-eating behavior of the Northwestern crow. Below are… Image attached
Answer published by the source
- Use the vapor pressures of ClF_3 given in the following table to calculate the… Image attached
Answer published by the source
- The patient shown below most likely has: <image 1> Image attached
Answer published by the source
- A finite automaton (FA) is an abstract machine that can be used to represent… Image attached
Answer published by the source
- After t = 0, each of the circuits in Figure (b) of <image 1> is source-free.… Image attached
Answer published by the source
- In <image 1>. v_(c)=sin2πT. Find an expression for i and calculate i at… Image attached
Answer published by the source
- Email #1: E-mail from Vice President of E.A.S.Y. Manufacturing to Legislative… Image attached
Answer published by the source
- Is <image 1> a Cayley diagram? Image attached
Answer published by the source
- Two steel plates with Sy = 50 ksi are attached by 3/8-in. parallel-loaded fillet… Image attached
Answer published by the source
- Find the equivalent torsional spring constant of the system shown in <image 1>.… Image attached
Answer published by the source
- Express the note value of <image 1> with three dotted notes Image attached
Answer published by the source
- Ammonia reacts with oxygen to yield nitrogen and water,<image 1>,Given this… Image attached
Answer published by the source
- Use the drawings to answer the question. Each drawing represents an… Image attached
Answer published by the source
- <image 1>If the ammeter in the circuit above reads zero, what is the resistance… Image attached
Answer published by the source
- As you sleep, your brain and body cycle through varying levels of brain wave… Image attached
Answer published by the source