{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3e6e661-4ebc-5dc0-8e33-c22c0c908b3d","task_key":"default--validation--b3e6e661-4ebc-5dc0-8e33-c22c0c908b3d","task_revision_id":"1","upstream_id":"","short_description":"does the us really have a designated survivor","config":"default","split":"validation","body":"{\"passage\":\"The practice of naming a designated survivor originated during the Cold War with its risk of nuclear attack. In 1947, the Presidential Succession Act established the line of succession and led to the continuity of government plan. In one special case the Housing and Urban Development Secretary Shaun Donovan was designated survivor for the 2010 State of the Union Address given by Barack Obama. At the same time Secretary of State Hillary Clinton was also absent from the address. However, Secret Service rules prevented Clinton from being named the designated survivor since it was public knowledge that she was at a conference in London during the event. Had a calamity occurred only in Washington and Clinton remained unharmed, she instead of Donovan would have become Acting President, as the Secretary of State is higher in the line of succession than the Housing and Urban Development Secretary.\",\"question\":\"does the us really have a designated survivor\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}