{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09591621-524c-522d-b42f-d57f21c4b85d","task_key":"default--validation--09591621-524c-522d-b42f-d57f21c4b85d","task_revision_id":"1","upstream_id":"","short_description":"do front turn signals have to be amber","config":"default","split":"validation","body":"{\"passage\":\"Until the early 1960s, most front turn signals worldwide emitted white light and most rear turn signals emitted red. The auto industry in the USA voluntarily adopted amber front-turn signals for most vehicles beginning in the 1963 model year, though the advent of amber signals was accompanied by legal stumbles in some states and front turn signals were still legally permitted to emit white light until FMVSS 108 took effect for the 1968 model year, whereupon amber became the only permissible front turn signal colour. Presently, most countries outside of the United States and Canada require that all front, side and rear turn signals produce amber light. Exceptions include Switzerland and New Zealand.\",\"question\":\"do front turn signals have to be amber\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}