{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7b682ad-a020-5ed9-8878-fc47a942a1a8","task_key":"default--validation--e7b682ad-a020-5ed9-8878-fc47a942a1a8","task_revision_id":"1","upstream_id":"","short_description":"is the isle of man a part of great britain","config":"default","split":"validation","body":"{\"passage\":\"In 1266, the island became part of Scotland under the Treaty of Perth, after being ruled by Norway. After a period of alternating rule by the kings of Scotland and England, the island came under the feudal lordship of the English Crown in 1399. The lordship revested into the British Crown in 1765, but the island never became part of the 18th-century Kingdom of Great Britain or its successors the United Kingdom of Great Britain and Ireland and the present-day United Kingdom: it retained its status as an internally self-governing Crown dependency.\",\"question\":\"is the isle of man a part of great britain\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}