benchmarks.wiki / Public workspace
MGSM
Mathematics / Multilingual
MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.
mgsm
Full text: eligible public problems include text, images and discussion.
Reference links
At a glance
What a problem looks like
One grade-school word problem in the selected language. The answer, the numeric answer and the worked equation are not part of the prompt.
How it is scored
The source ships the answer, the numeric answer and the equation; this catalogue keeps all three in restricted storage and never renders them.
Why it is hard
The arithmetic is elementary, so anything lost against the English score is lost in the language, not the mathematics — including in languages with little presence in training data.
Cite
@article{shi2022mgsm,
title={Language Models are Multilingual Chain-of-Thought Reasoners},
author={Freda Shi and Mirac Suzgun and Markus Freitag and Xuezhi Wang and Suraj Srivats and Soroush Vosoughi and Hyung Won Chung and Yi Tay and Sebastian Ruder and Denny Zhou and Dipanjan Das and Jason Wei},
journal={arXiv preprint arXiv:2210.03057},
year={2022}
}Discussion
Contribute
Share a reproduction, report an evaluation issue, or suggest a correction to this benchmark overview.
Tasks
Whole public benchmark.
- Public problems
- 200
- Formats
- math (200)
- Problems with images
- 0
- Answer availability
- Answer published by the source (200)
- Configs
- en (200)
- Splits
- test (200)
- Awaiting a first discussion
- 200
- Problems with a discussion
- 0
- Public contributions
- 0
Provenance and terms
Pinned source revisions, newest first:
b2f13d426afe3be8d69a7e739b36724db8b66bbc· acquired 2026-09-12 · released28706c95f1eb2f13d426afe3be8d69a7e739b36724db8b66bbc· acquired 2026-09-12 · releasea7c8fef5f04f
- A pen costs as much as a pencil and eraser combined. A pencil costs …
Answer published by the source
- Aleena subscribed to a streaming service that charges her …
Answer published by the source
- A tank of water has a depth of 17 feet on Monday. On Tuesday, the tank had 7…
Answer published by the source
- Cody eats three times as many cookies as Amir eats. If Amir eats 5 cookies, how…
Answer published by the source
- Artie has a flower stand at the Farmers Market. He sells three kinds of flowers:…
Answer published by the source
- In a room, there are various toys: 5 red cars, 3 action figures, and a doll. The…
Answer published by the source
- A raspberry bush has 6 clusters of 20 fruit each and 67 individual fruit…
Answer published by the source
- A wooden bridge can carry no more than 5000 pounds. A delivery truck filled with…
Answer published by the source
- Adrien's total salary was 30 percent higher than Lylah's. Four years later, his…
Answer published by the source
- Luke is spending time at the beach building sandcastles. He eventually notices…
Answer published by the source
- Tom plants 10 trees a year. Every year he also chops down 2 trees a year. He…
Answer published by the source
- Josh decides to try flipping a house. He buys a house for …
Answer published by the source
- Juan and his brother Carlos are selling lemonade. For each gallon they make it…
Answer published by the source
- Bailey starts with a certain amount of money. Then she receives a weekly…
Answer published by the source
- 200 pounds of carrots are to be distributed to 40 restaurants in a certain city.…
Answer published by the source
- On Monday, Walt walked 4 miles. Tuesday, he walked 6 times as many miles as he…
Answer published by the source
- A new program had 60 downloads in the first month. The number of downloads in…
Answer published by the source
- Carl buys ten packs of cookies. Each pack of cookies has six cookies inside.…
Answer published by the source
- Brandon's iPhone is four times as old as Ben's iPhone. Ben's iPhone is two times…
Answer published by the source
- Well's mother sells watermelons, peppers, and oranges at the local store. A…
Answer published by the source
- Richard lives in an apartment building with 15 floors. Each floor contains 8…
Answer published by the source
- Lloyd earns …
Answer published by the source
- Every day, Wendi feeds each of her chickens three cups of mixed chicken feed,…
Answer published by the source
- According to its nutritional info, a bag of chips has 250 calories per serving.…
Answer published by the source
- Jake is walking through the Museum of Entomology. He sees 80 spiders with 8 legs…
Answer published by the source
- Nissa hires 60 seasonal workers to play elves in her department store's Santa…
Answer published by the source
- A football team played 22 games. They won 8 more than they lost. How many did…
Answer published by the source
- Emily has 4 kids named Amy, Jackson, Corey, and James. Amy is 5 years older than…
Answer published by the source
- Carla is downloading a 200 GB file. Normally she can download 2 GB/minute, but…
Answer published by the source
- Raphael went to buy some school supplies. He bought 4 pens which cost …
Answer published by the source
- A treasure hunter found a buried treasure chest filled with gems. There were 175…
Answer published by the source
- Sadie slept 8 hours on Monday. For the next two days, she slept 2 hours less,…
Answer published by the source
- Janet’s ducks lay 16 eggs per day. She eats three for breakfast every morning…
Answer published by the source
- Marissa is hiking a 12-mile trail. She took 1 hour to walk the first 4 miles,…
Answer published by the source
- Claire makes a 3 egg omelet every morning for breakfast. How many dozens of eggs…
Answer published by the source
- Billy is peeling and cutting potatoes in preparation for making potato salad for…
Answer published by the source
- Jenna and her mother picked some apples from their apple farm. Jenna picked half…
Answer published by the source
- Candice put 80 post-it notes in her purse before she headed out to her job at…
Answer published by the source
- Gloria is shoe shopping when she comes across a pair of boots that fit her shoe…
Answer published by the source
- Jennie is helping at her mom's office. She has a pile of 60 letters needing…
Answer published by the source
- John buys 2 pairs of shoes for each of his 3 children. They cost …
Answer published by the source
- Russell works at a pet store and is distributing straw among the rodents. The…
Answer published by the source
- Cecilia just bought a new puppy. According to her veterinarian, she has to feed…
Answer published by the source
- John has 10 hectares of a pineapple field. There are 100 pineapples per hectare.…
Answer published by the source
- Greg has an alarm set to ring three times a day as a reminder. When the alarm…
Answer published by the source
- Frankie watches TV after he finishes his homework every night. On Monday and…
Answer published by the source
- Gene is sewing a quilt out of old souvenir t-shirts. He has one shirt from each…
Answer published by the source
- Ted the T-Rex was planning to bring potato salad to the dinosaur picnic. He…
Answer published by the source
- Mike plays ping pong for 40 minutes. In the first 20 minutes, he scores 4…
Answer published by the source
- Shiela bought five cell phones for …
Answer published by the source