{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"44858586-5ca5-594d-9e5f-04470191d3b7","task_key":"default--validation--44858586-5ca5-594d-9e5f-04470191d3b7","task_revision_id":"1","upstream_id":"","short_description":"did it rain oil in the gulf war","config":"default","split":"validation","body":"{\"passage\":\"From the perspective of ground forces, apart from the occasional ``oil rain'' experienced by troops very close to spewing wells, one of the more commonly experienced effects of the oil field fires were the ensuing smoke plumes which rose into the atmosphere and then precipitated or fell out of the air via dry deposition and by rain. The pillar-like plumes frequently broadened and joined up with other smoke plumes at higher altitudes, producing a cloudy grey overcast effect, as only about 10% of all the fires corresponding with those that originated from ``oil lakes'' produced pure black soot filled plumes, 25% of the fires emitted white to grey plumes, while the remainder emitted plumes with colors between grey and black. For example, one Gulf War veteran stated:\",\"question\":\"did it rain oil in the gulf war\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}