{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32c77515-0b19-5f63-b27e-509601a29718","task_key":"default--validation--32c77515-0b19-5f63-b27e-509601a29718","task_revision_id":"1","upstream_id":"","short_description":"are you in the navy if you go to the naval academy","config":"default","split":"validation","body":"{\"passage\":\"Students at the naval academy are addressed as Midshipman, an official military rank and paygrade. As midshipmen are actually in the United States Navy, starting from the moment that they raise their hands and affirm the oath of office at the swearing-in ceremony, they are subject to the Uniform Code of Military Justice, of which USNA regulations are a part, as well as to all executive policies and orders formulated by the Department of the Navy. The same term covers both males and females. Upon graduation, most naval academy midshipmen are commissioned as ensigns in the Navy or second lieutenants in the Marine Corps and serve a minimum of five years after their commissioning. If they are selected to serve as a pilot (aircraft), they will serve 8--11 years minimum from their date of winging, and if they are selected to serve as a naval flight officer they will serve 6--8 years. Foreign midshipmen are commissioned into the armed forces of their native countries.\",\"question\":\"are you in the navy if you go to the naval academy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}