{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"594aeeab-2380-5dcb-8bad-a9a5add29597","task_key":"default--validation--594aeeab-2380-5dcb-8bad-a9a5add29597","task_revision_id":"1","upstream_id":"","short_description":"is there such thing as a blue wasp","config":"default","split":"validation","body":"{\"passage\":\"The blue mud dauber (Chalybion californicum) is a metallic blue species of mud dauber wasp that is the primary predator of black widow spiders. Females build their own nests, but occasionally refurbish nests abandoned by other mud dauber wasps, particularly Sceliphron. It is not normally aggressive. It is similar in shape and colour to the steel-blue cricket hunter (Chlorion aerarium). Like other types of wasps, males do not have an ovipositor, therefore cannot sting.\",\"question\":\"is there such thing as a blue wasp\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}