{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e441e51-ec2a-588f-8226-b5a00759fa68","task_key":"default--validation--5e441e51-ec2a-588f-8226-b5a00759fa68","task_revision_id":"1","upstream_id":"","short_description":"does the white house residence have a kitchen","config":"default","split":"validation","body":"{\"passage\":\"The Ground Floor of the White House originally contained service rooms. The White House is built on a small slight hill that slopes to the south. To provide access to the north side of the Ground Floor, the area around the north side of the mansion and its northeast and northwest corners was excavated to provide light and air to this half of the Ground Floor. Architect James Hoban designed the Ground Floor so that the kitchen was directly beneath the Entrance Hall, the door to the kitchen below the North Portico. Storerooms were east of the kitchen, while a toilet and dishwashing room were to the west. The kitchen was relocated into the two rooms in the northwest corner of the Ground Floor by 1846, while the old kitchen space as transformed into an informal sitting room/reception space. As of 2010, this large central space originally occupied by the kitchen in the early 1800s had been subdivided into offices for the White House Curator and the United States Secret Service. The kitchen, too, continues to occupy the three rooms (somewhat altered in size now) in the northwest corner of the Ground Floor.\",\"question\":\"does the white house residence have a kitchen\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}