AssistantBench collects realistic, time-consuming tasks that can only be answered by working through the live web, written so that each has one determinable answer. It measures whether a web agent is actually useful.
Full text181 tasks
Metric
accuracy and answer rate over the held-out test set, scored by the official submission service
Size
All 181 tasks imported from the default / test selection, with a source-row limit of 200.
License
apache-2.0 (declared on the Hugging Face dataset card)
BrowseComp evaluates web browsing and the ability to identify answers from multiple clues. This catalog supports introductions and discussion of search methods without republishing decrypted questions or answers.
BrowseComp-Plus supports evaluation of retrieval methods using BrowseComp tasks and a search corpus. This catalog links to the official distribution without republishing plaintext questions or corpus content.