{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1376b080-2425-553e-9cff-f84af058bc0e","task_key":"default--validation--1376b080-2425-553e-9cff-f84af058bc0e","task_revision_id":"1","upstream_id":"","short_description":"is a crawfish and a crawdad the same thing","config":"default","split":"validation","body":"{\"passage\":\"Crayfish, also known as crawfish, crawdads, crawldads, freshwater lobsters, mountain lobsters, mudbugs or yabbies, are freshwater crustaceans resembling small lobsters (to which they are related). Taxonomically, they are members of the superfamilies Astacoidea and Parastacoidea. They breathe through feather-like gills. Some species are found in brooks and streams where there is running fresh water, while others thrive in swamps, ditches, and paddy fields. Most crayfish cannot tolerate polluted water, although some species such as Procambarus clarkii are hardier. Crayfish feed on animals and plants, either living or decomposing, and detritus.\",\"question\":\"is a crawfish and a crawdad the same thing\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}