{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"33c4cc7b-5874-5244-bc59-c19761fe648a","task_key":"default--validation--33c4cc7b-5874-5244-bc59-c19761fe648a","task_revision_id":"2","upstream_id":"","short_description":"can you cut the stock off a shotgun","config":"default","split":"validation","body":"{\"passage\":\"The bank robber Clyde Barrow modified his Browning A-5 shotgun by cutting the barrel down to the same length as the magazine tube, and shortening the stock by 5 to 6 inches (125 to 150 mm) to make it more concealable. A small, 10--12-inch (250--300 mm) strap was attached to both ends of the butt of the gun, and was looped around his shoulder, concealing the gun between his arm and chest under his jacket in the manner of a shoulder holster. The gun was drawn up quickly and fired from the shoulder under which it was carried. Barrow dubbed it the ``Whippit'', as he was able to ``whip it'' out easily.\",\"question\":\"can you cut the stock off a shotgun\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}