benchmarks.wiki / Public workspace

MATH

Mathematics

MATH organises 12,500 high-school competition problems into seven subjects and five difficulty levels, each with a full worked solution. It underlies much of the later mathematics evaluation work; this catalogue imports the algebra / test selection.

math

Full text200 tasksProblems imported

Official source

Full text: eligible public problems include text, images and discussion.

At a glance

What a problem looks like

A problem statement in LaTeX, with its subject and difficulty level. The worked solution is not part of the prompt.

Read an actual problem

How it is scored

The source ships a step-by-step solution with every problem; this catalogue keeps it in restricted storage and never renders it.

Metric: accuracy on the final boxed answer

Why it is hard

The problems are written for students who have the technique and need to choose it. Difficulty is stated per problem, so level 5 items are hard by construction rather than by accident.

Cite

@article{hendrycks2021math,
  title={Measuring Mathematical Problem Solving With the MATH Dataset},
  author={Dan Hendrycks and Collin Burns and Saurav Kadavath and Akul Arora and Steven Basart and Eric Tang and Dawn Song and Jacob Steinhardt},
  journal={arXiv preprint arXiv:2103.03874},
  year={2021}
}

Discussion

Contribute

Share a reproduction, report an evaluation issue, or suggest a correction to this benchmark overview.

Tasks

Whole public benchmark.

Public problems
200
Formats
math (200)
Problems with images
0
Answer availability
Answer published by the source (200)
Configs
algebra (200)
Splits
test (200)
Awaiting a first discussion
200
Problems with a discussion
0
Public contributions
0

Provenance and terms

Pinned source revisions, newest first:

  • 21a5633873b6a120296cce3e2df9d5550074f4a3 · acquired 2026-09-12 · release ae4d22a7a5ac
  • 21a5633873b6a120296cce3e2df9d5550074f4a3 · acquired 2026-09-12 · release 7febcb3508c0