{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"43394bfe-e548-54d9-8140-507f7f9b578b","task_key":"default--validation--43394bfe-e548-54d9-8140-507f7f9b578b","task_revision_id":"1","upstream_id":"","short_description":"is there a river in ellicott city md","config":"default","split":"validation","body":"{\"passage\":\"The town is prone to flooding from the Patapsco River and its tributary the Tiber River. These floods have had a major impact on the history of the town, often destroying important businesses and killing many. Ellicott City has had major devastating floods in 1817, 1837, 1868, 1901, 1917, 1923, 1938, 1942, 1952, 1956, 1972 (Hurricane Agnes), 1975 (Hurricane Eloise), 1989, 2011, 2016, and 2018. The 1868 flood washed away 14 houses, killing 39 to 43 (accounts vary) in and around Ellicott City. It wiped out the Granite Manufacturing Cotton Mill, Charles A. Gambrill's Patapsco Mill, John Lee Carroll's mill buildings, and dozens of homes. One mill was rebuilt by Charles Gambrill, which remained in operation until a fire in 1916.\",\"question\":\"is there a river in ellicott city md\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}