Benchmark AI / Public workspace

Benchmarks

Compare the whole catalogue

Choose a field to explore public problems and discussions.

Full text

Problem text is available, with images and a page per problem. The API reports this as full.

Overview only

An introduction, the official source and general discussion are available; problem text, images and individual pages are not published here. The API reports this as metadata_only.

Fields and counts refer to this catalog page.

• Agents / Multimodal

  GAIA

  gaia

  GAIA evaluates general AI assistants on tasks involving information gathering and tool use. Some tasks include attachments; this catalog provides an introduction in view of access and resharing restrictions.

  Overview onlyNot imported on this site

• Reasoning / Multimodal

  Humanity's Last Exam

  hle

  Humanity's Last Exam evaluates AI knowledge and reasoning across academic disciplines. It includes text and image questions; this catalog provides an introduction and official links in accordance with the publisher's req…

  Overview onlyNot imported on this site

• Multimodal

  MMMU-Pro

  mmmu-pro

  MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision …

  Full text200 tasksProblems imported

• Mathematics / Science / Multimodal

  OlympiadBench

  olympiadbench

  OlympiadBench evaluates scientific reasoning on Olympiad-level mathematics and physics problems. Its official description lists 8,476 English and Chinese problems with separate text-only and multimodal settings.

  Full text200 tasksProblems imported