{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"75a8b1d3-a972-5cbe-a792-775411eafb46","task_key":"default--validation--75a8b1d3-a972-5cbe-a792-775411eafb46","task_revision_id":"1","upstream_id":"","short_description":"is breaking and entering into a car a felony","config":"default","split":"validation","body":"{\"passage\":\"In the United States, burglary is prosecuted as a felony or misdemeanor and involves trespassing and theft, entering a building or automobile, or loitering unlawfully with intent to commit any crime, not necessarily a theft--for example, vandalism. Even if nothing is stolen in a burglary, the act is a statutory offense. Buildings can include hangars, sheds, barns, and coops; burglary of boats, aircraft, trucks, and railway cars is possible. Burglary may be an element in crimes involving rape, arson, kidnapping, identity theft, or violation of civil rights; indeed, the ``plumbers'' of the Watergate scandal were technically burglars. As with all legal definitions in the U.S., the foregoing description may not be applicable in every jurisdiction, since there are 50 separate state criminal codes, plus federal and territorial codes in force.\",\"question\":\"is breaking and entering into a car a felony\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}