benchmarks.wiki / Public workspace
GSM8K
Mathematics
GSM8K is a set of grade-school word problems that each need several arithmetic steps. It remains a standard reference point for multi-step reasoning.
gsm8k
Full text: eligible public problems include text, images and discussion.
Reference links
At a glance
What a problem looks like
A short word problem in the question field. The worked solution and final answer are kept out of the prompt.
How it is scored
For the 200 imported problems, the source ships an answer with every problem; this catalogue keeps it in restricted storage and never renders it.
Why it is hard
Each problem is elementary in isolation; the difficulty is carrying several dependent steps without arithmetic slips.
Cite
@article{cobbe2021gsm8k,
title={Training Verifiers to Solve Math Word Problems},
author={Cobbe, Karl and Kosaraju, Vineet and Bavarian, Mohammad and Chen, Mark and Jun, Heewoo and Kaiser, Lukasz and Plappert, Matthias and Tworek, Jerry and Hilton, Jacob and Nakano, Reiichiro and Hesse, Christopher and Schulman, John},
journal={arXiv preprint arXiv:2110.14168},
year={2021}
}Discussion
Contribute
Share a reproduction, report an evaluation issue, or suggest a correction to this benchmark overview.
Tasks
Whole public benchmark.
- Public problems
- 200
- Formats
- text (200)
- Problems with images
- 0
- Answer availability
- Answer published by the source (200)
- Configs
- main (200)
- Splits
- test (200)
- Awaiting a first discussion
- 200
- Problems with a discussion
- 0
- Public contributions
- 0
Provenance and terms
Pinned source revisions, newest first:
740312add88f781978c0658806c59bc2815b9866· acquired 2026-09-11 · releasea8f963ca5e1e
- Candice put 80 post-it notes in her purse before she headed out to her job at…
Answer published by the source
- Julia’s boat sprang a leak while she was out on the lake. The boat was taking on…
Answer published by the source
- Elaine initially had 20 Pokemon cards. After a month, she collected three times…
Answer published by the source
- Bailey starts with a certain amount of money. Then she receives a weekly…
Answer published by the source
- Charlie has three times as many Facebook friends as Dorothy. James has four…
Answer published by the source
- Sadie slept 8 hours on Monday. For the next two days, she slept 2 hours less,…
Answer published by the source
- Henry made two stops during his 60-mile bike trip. He first stopped after 20…
Answer published by the source
- There are four schools competing at a basketball tournament. Each school has…
Answer published by the source
- Dan plants 3 rose bushes. Each rose bush has 25 roses. Each rose has 8 thorns.…
Answer published by the source
- Kelian has two recipes for preparing dishes, one having 20 instructions and the…
Answer published by the source
- In a race with 240 Asians, 80 were Japanese, and the rest were Chinese. If the…
Answer published by the source
- Mary is an avid gardener. Yesterday, she received 18 new potted plants from her…
Answer published by the source
- Gene is sewing a quilt out of old souvenir t-shirts. He has one shirt from each…
Answer published by the source
- Sandra, the florist around the corner, is very unhappy with Fred's incomplete…
Answer published by the source
- Carlos is planting a lemon tree. The tree will cost …
Answer published by the source
- Grace weighs 125 pounds. Alex weighs 2 pounds less than 4 times what Grace…
Answer published by the source
- Jessica is trying to figure out how much to pay on all her debts each month. Her…
Answer published by the source
- Katy makes coffee using teaspoons of sugar and cups of water in the ratio of…
Answer published by the source
- Marie ordered one chicken meal that costs 12,5packsofmilkthatcosts3…
Answer published by the source
- Siobhan has 2 fewer jewels than Aaron. Aaron has 5 more jewels than half of…
Answer published by the source
- A company pays each of its employees …
Answer published by the source
- Mark took a test yesterday that consisted of 75 questions. He completed the test…
Answer published by the source
- A fog bank rolls in from the ocean to cover a city. It takes 10 minutes to cover…
Answer published by the source
- Shawnda decides that her neighborhood kids could really use a bike inflation…
Answer published by the source
- There are 700 bees in a hive. There are twice as many worker bees as baby bees,…
Answer published by the source
- Tom plants 10 trees a year. Every year he also chops down 2 trees a year. He…
Answer published by the source
- Brandon's iPhone is four times as old as Ben's iPhone. Ben's iPhone is two times…
Answer published by the source
- Of the 20 available cars for rent, 12 are automatic cars, 4 are manual cars, and…
Answer published by the source
- In a room, there are various toys: 5 red cars, 3 action figures, and a doll. The…
Answer published by the source
- Sandra's neighbor gives her a basket of 9 eggs every time she babysits their…
Answer published by the source
- Toula went to the bakery and bought various types of pastries. She bought 3…
Answer published by the source
- Meredith is a freelance blogger who writes about health topics and submits to…
Answer published by the source
- Solo has to read 4 pages from his Science textbook, 20 pages from his Social…
Answer published by the source
- Out of the 200 Grade 5 students, 2/5 are boys and 2/3 of the girls are in the…
Answer published by the source
- A classroom has a whiteboard which is shared between the 4 teachers who take…
Answer published by the source
- Artie has a flower stand at the Farmers Market. He sells three kinds of flowers:…
Answer published by the source
- Gloria is shoe shopping when she comes across a pair of boots that fit her shoe…
Answer published by the source
- In the city of Soda, there are exactly 23786 inhabitants. They include 8417 men…
Answer published by the source
- Well's mother sells watermelons, peppers, and oranges at the local store. A…
Answer published by the source
- James decides to run 3 sprints 3 times a week. He runs 60 meters each sprint.…
Answer published by the source
- Raphael went to buy some school supplies. He bought 4 pens which cost …
Answer published by the source
- There are twice as many boys as girls at Dr. Wertz's school. If there are 60…
Answer published by the source
- Mandy owes Benedict …
Answer published by the source
- Jenna and her mother picked some apples from their apple farm. Jenna picked half…
Answer published by the source
- Jimmy has 2morethantwicethemoneyEthelhas.IfEthalhas8, how much…
Answer published by the source
- Janet buys a brooch for her daughter. She pays …
Answer published by the source
- Tom's ship can travel at 10 miles per hour. He is sailing from 1 to 4 PM. He…
Answer published by the source
- The marching band is ordering new uniforms. Each uniform comes with a hat that…
Answer published by the source
- Gunter is trying to count the jelly beans in a jar. He asks his friends how many…
Answer published by the source
- Gretchen has 110 coins. There are 30 more gold coins than silver coins. How many…
Answer published by the source