{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6fcb833c-e8f3-54c6-9db0-48c9771c8bc1","task_key":"default--validation--6fcb833c-e8f3-54c6-9db0-48c9771c8bc1","task_revision_id":"1","upstream_id":"","short_description":"is a catbird the same as a mockingbird","config":"default","split":"validation","body":"{\"passage\":\"New World catbirds are two monotypic genera from the mimid family (Mimidae) of the passeridan superfamily Muscicapoidea. Among the Mimidae, they represent independent basal lineages probably closer to the Caribbean thrasher and trembler assemblage than to the mockingbirds and Toxostoma thrashers:\",\"question\":\"is a catbird the same as a mockingbird\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}