Benchmark AI / Public workspace
Catalogue overview
Compare the public catalogue in one place.
Counts cover public problems with full text, not the size of the upstream datasets. An em dash means not recorded. Overview-only benchmarks provide catalogue metadata without problem text.
Answer availability describes what the source distributes; no answer values are shown. Awaiting a first attempt means no public discussion is recorded.
Try a random problem · Find a problem awaiting an attempt · Read this catalogue as JSON
| Benchmark | Field | Publication mode | Problems | Formats | Answer availability | Images | Awaiting a first attempt |
|---|---|---|---|---|---|---|---|
| Terminal-Bench 2.1 | Agents · Code | Full text | 89 | text: 89 | Availability unknown: 89 | 0 | 89 |
| GAIA | Agents · Multimodal | Overview only | — | — | — | — | — |
| BrowseComp | Agents · Search | Overview only | — | — | — | — | — |
| BrowseComp-Plus | Agents · Search | Overview only | — | — | — | — | — |
| Humanity's Last Code Exam | Code | Full text | 146 | text: 146 | Source answer published: 146 | 0 | 146 |
| LiveCodeBench | Code | Full text | 100 | text: 100 | Source answer published: 100 | 0 | 100 |
| SWE-Bench Pro | Code · Agents | Full text | 200 | text: 200 | Source answer published: 200 | 0 | 200 |
| FrontierMath | Mathematics | Overview only | — | — | — | — | — |
| Omni-MATH | Mathematics | Full text | 200 | text: 200 | Source answer published: 200 | 0 | 200 |
| OlympiadBench | Mathematics · Science · Multimodal | Full text | 200 | text: 200 | Source answer published: 200 | 0 | 200 |
| MMMU-Pro | Multimodal | Full text | 200 | text: 200 | Source answer published: 200 | 240 | 200 |
| ARC-AGI-2 | Reasoning | Full text | 120 | grid: 120 | Source answer published: 120 | 0 | 118 |
| BIG-Bench Extra Hard (BBEH) | Reasoning | Full text | 200 | text: 200 | Source answer published: 200 | 0 | 200 |
| ZebraLogicBench | Reasoning | Full text | 200 | text: 200 | Source answer published: 200 | 0 | 200 |
| ARC-AGI-3 | Reasoning · Agents | Overview only | — | — | — | — | — |
| LongBench v2 | Reasoning · Long context | Full text | 200 | text: 200 | Source answer published: 200 | 0 | 200 |
| Humanity's Last Exam | Reasoning · Multimodal | Overview only | — | — | — | — | — |
| CritPt | Science | Full text | 70 | text: 70 | Source answer published: 70 | 0 | 70 |
| FrontierScience | Science | Full text | 100 | text: 100 | Source answer published: 100 | 0 | 100 |
| SciCode | Science · Code | Full text | 65 | scicode: 15 scicode-step: 50 | Source answer published: 65 | 0 | 65 |