{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"52a072cc-35ec-5380-9db3-22342284d491","task_key":"default--validation--52a072cc-35ec-5380-9db3-22342284d491","task_revision_id":"1","upstream_id":"","short_description":"do the great lakes connect to the ocean","config":"default","split":"validation","body":"{\"passage\":\"Together with the Saint Lawrence Seaway, the Waterway allows both ocean-going vessels and the ore and coal-bearing lake freighters to travel from the system's saltwater outlet to its far interior. The Waterway has larger locks and deeper drafts than the lower Seaway, limiting large freighters to the four lakes upstream of the Welland Canal and Lake Ontario, and similarly restricting passage beyond the canal by larger ocean vessels. The two waterways are often jointly and simply referred to as the ``St. Lawrence Seaway'', since the Great Lakes, together with the St. Lawrence River, comprise a single navigable body of freshwater linking the Atlantic Ocean to the continental interior.\",\"question\":\"do the great lakes connect to the ocean\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}