Benchmark AI / Public workspace

Benchmarks

Compare the whole catalogue

Choose a field to explore public problems and discussions.

Full text

Problem text is available, with images and a page per problem. The API reports this as full.

Overview only

An introduction, the official source and general discussion are available; problem text, images and individual pages are not published here. The API reports this as metadata_only.

Fields and counts refer to this catalog page.

• Science

  CritPt

  critpt

  CritPt evaluates scientific understanding and multi-step reasoning and computation on research-level physics problems. Its public dataset contains 70 challenges with problem descriptions and code templates.

  Full text70 tasksProblems imported

• Science

  FrontierScience

  frontierscience

  FrontierScience evaluates the ability to solve expert-level scientific tasks. Its public data separates olympiad and research problems so that competition and research tasks can be examined independently.

  Full text100 tasksProblems imported

• Mathematics / Science / Multimodal

  OlympiadBench

  olympiadbench

  OlympiadBench evaluates scientific reasoning on Olympiad-level mathematics and physics problems. Its official description lists 8,476 English and Chinese problems with separate text-only and multimodal settings.

  Full text200 tasksProblems imported

• Science / Code

  SciCode

  scicode

  SciCode evaluates the ability to solve scientific research problems through code. Problems are decomposed into subproblems; this dev import preserves the relationships between 15 parent problems and 50 subproblems.

  Full text65 tasksProblems imported