{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d934e0be-a1a4-5700-a3a5-f6444eaa1637","task_key":"default--validation--d934e0be-a1a4-5700-a3a5-f6444eaa1637","task_revision_id":"1","upstream_id":"","short_description":"can you drink the water in flint now","config":"default","split":"validation","body":"{\"passage\":\"The Flint water crisis first started in 2014 when the drinking water source for the city of Flint, Michigan was changed from Lake Huron and the Detroit River to the cheaper Flint River. Due to insufficient water treatment, lead leached from the lead water pipes into the drinking water, exposing over 100,000 residents. After a pair of scientific studies proved lead contamination was present in the water supply, a federal state of emergency was declared in January 2016 and Flint residents were instructed to use only bottled or filtered water for drinking, cooking, cleaning, and bathing. As of early 2017, the water quality had returned to acceptable levels; however, residents were instructed to continue to use bottled or filtered water until all the lead pipes have been replaced, which is expected to be completed no sooner than 2020.\",\"question\":\"can you drink the water in flint now\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}