{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3868aca4-3af8-5821-8f19-7490da344e57","task_key":"default--validation--3868aca4-3af8-5821-8f19-7490da344e57","task_revision_id":"1","upstream_id":"","short_description":"is there a cable car in new york","config":"default","split":"validation","body":"{\"passage\":\"On April 18, 2006, at about 5:22 p.m. EDT, the two trams were stuck over the East River for seven hours because of mechanical problems, trapping 69 people. Rescue baskets capable of holding up to 15 people were sent up to the stranded cable cars at 10:55 p.m., with children and elderly going first, and each rescue taking about 20 minutes. These baskets also carried supplies to the trams, such as blankets, baby formula, and food, for the remaining passengers. Passengers on the Roosevelt Island--bound tram were rescued by about 2:55 a.m. on April 19, while those on the Manhattan-bound tram were not rescued until 4:07 a.m.\",\"question\":\"is there a cable car in new york\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}