{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9acd063a-7609-5b31-96c9-e2c1ec14ce9c","task_key":"default--validation--9acd063a-7609-5b31-96c9-e2c1ec14ce9c","task_revision_id":"1","upstream_id":"","short_description":"is it safe to swim in brisbane river","config":"default","split":"validation","body":"{\"passage\":\"Environmentally, the river is in a poor condition and has been so for many years. In 2000, the Brisbane River estuary did not meet the national guidelines for environmental standards. The lower reaches received a very poor rating in the 2008 Healthy Waterways report, an annual assessment of river water quality. The major causes of pollution are excess nutrients, hydrocarbons, pesticides and bacteria which become concentrated in the river and its sediment after flowing off surrounding lands. The river is also considered too murky and it is not recommended to swim in its waters.\",\"question\":\"is it safe to swim in brisbane river\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}