{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc2f4c22-eea2-5673-b346-257ab2eb4fe2","task_key":"default--validation--fc2f4c22-eea2-5673-b346-257ab2eb4fe2","task_revision_id":"1","upstream_id":"","short_description":"has there ever been an earthquake in tennessee","config":"default","split":"validation","body":"{\"passage\":\"Damage was confined to Illinois, Indiana, Kentucky, Tennessee, and south-central Iowa, and largely consisted of fallen chimneys, foundation cracks, collapsed parapets, and overturned tombstones. In one home in Dale, Illinois, near Tuckers Corners and southwest of McLeansboro, the quake cracked interior walls, plaster, and chimneys. Using a type of victim study, the local post office surveyed residents and implemented a field inspection which indicated the strongest shaking (MM VII) took place in the Wabash Valley, Ohio Valley, and other nearby south-central Illinois lowlands. Outside this four-state zone, oscillating objects including cars, chimneys, and the Gateway Arch were reported to authorities.\",\"question\":\"has there ever been an earthquake in tennessee\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}