{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"1e6fd973-383b-5a86-8839-58ecd89bf13d","task_key":"default--validation--1e6fd973-383b-5a86-8839-58ecd89bf13d","task_revision_id":"2","upstream_id":"","short_description":"is the united states a part of the european union","config":"default","split":"validation","body":"{\"passage\":\"Relations between the United States of America (US) and the European Union (EU) are the bilateral relations between that country and the supranational organization. The US and EU have been interacting for more than sixty years. US-EU relations officially started in 1953 when US ambassadors visited the European Coal and Steel Community (former EU). The two parties share a good relationship which is strengthened by cooperation on trade, military defense and shared values.\",\"question\":\"is the united states a part of the european union\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}