{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4e52471e-b734-58d0-9ddb-a795e839efae","task_key":"default--validation--4e52471e-b734-58d0-9ddb-a795e839efae","task_revision_id":"1","upstream_id":"","short_description":"is air canada part of one world alliance","config":"default","split":"validation","body":"{\"passage\":\"On 19 May 1999, LanChile (known as LAN and from 2016 as LATAM Chile) became a member-elect, the alliance's first representative from Latin America. LanChile's two subsidiaries, LAN Express and LAN Perú, would also join the alliance. Irish carrier Aer Lingus was formally elected on board and confirmed as the ninth member of the alliance on 2 December 1999. As LanChile and Aer Lingus joined on 1 June 2000, Canadian Airlines left the alliance, following the airline's purchase by Air Canada, a member of the rival Star Alliance.\",\"question\":\"is air canada part of one world alliance\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}