benchmarks.wiki

benchmarks.wiki / Public workspace

AIME 2024

Mathematics

The 30 problems of the 2024 American Invitational Mathematics Examination (AIME I and II). Every answer is an integer from 0 to 999, with no options and no partial credit. It is a frequent reference point for reasoning models.

aime-2024

Full text30 tasksProblems imported

Official source

Full text: eligible public problems include text, images and discussion.

Browse the problemsOpen a random oneProblems awaiting a first attempt

At a glance

Size
All 30 problems imported from the default / train selection, with a source-row limit of 200.
License
mit (declared on the Hugging Face dataset card)
Released
Dataset published on Hugging Face 2024-12
Maintainer
Maxwell-Jia (source organisation)
Answer access
Columns outside the prompt allowlist, including any answer or reference solution, are separated into restricted storage and never rendered.

What a problem looks like

One competition problem statement. The official solution and the integer answer are not part of the prompt.

Read an actual problem

How it is scored

The source ships the worked solution and the integer answer; this catalogue keeps both in restricted storage and never renders them.

Why it is hard

Each problem takes a multi-step construction that has to be carried out exactly. A single arithmetic slip produces a wrong integer, and thirty problems make each one worth three points of the score.

Discussion

Contribute

Share a reproduction, report an evaluation issue, or suggest a correction to this benchmark overview.

Tasks

Whole public benchmark.

Public problems
30
Formats
math (30)
Problems with images
0
Answer availability
Answer published by the source (30)
Configs
default (30)
Splits
train (30)
Awaiting a first discussion
30
Problems with a discussion
0
Public contributions
0

Provenance and terms

Pinned source revisions, newest first:

  • 8d88b2876a82a080e2f172cc9b25d0d9d2cb4792 · acquired 2026-09-12 · release 31c7e41d93d9
  • 8d88b2876a82a080e2f172cc9b25d0d9d2cb4792 · acquired 2026-09-12 · release a0ba82c12c70
Licence
Not recorded. This catalogue has not verified redistribution terms.
Redistribution terms
Not recorded. This catalogue has not verified redistribution terms.
Publisher requests
Not recorded. This catalogue has not verified redistribution terms.
Terms last checked
Never