{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d6066ba8-f2a2-58a9-961c-c5c6bf5acf2e","task_key":"default--validation--d6066ba8-f2a2-58a9-961c-c5c6bf5acf2e","task_revision_id":"1","upstream_id":"","short_description":"does the chevy cobalt ss come in automatic","config":"default","split":"validation","body":"{\"passage\":\"The Cobalt SS was GM's first foray into the tuner market, launching with a 205 hp (153 kW; 208 PS) supercharged 2.0 L engine in late 2004 as a 2005 model, paired only with the F35 manual transmission of Opel. The following year, a naturally aspirated 1SS model equipped with GM's new 2.4 L 171 hp (128 kW; 173 PS) engine was added; it had both automatic and manual transmission options. Production of the supercharged version continued until 2007; after a brief hiatus the SS relaunched in the second quarter of 2008 with a more economical and powerful turbocharged 2.0 L engine producing 260 hp (194 kW; 264 PS) before all Cobalt production ended in 2010. (See timeline).\",\"question\":\"does the chevy cobalt ss come in automatic\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}