{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c616c4b0-6d19-58d5-b851-eab4acf0e386","task_key":"default--validation--c616c4b0-6d19-58d5-b851-eab4acf0e386","task_revision_id":"1","upstream_id":"","short_description":"is a host required for syphilis to survive","config":"default","split":"validation","body":"{\"passage\":\"Treponema pallidum subspecies pallidum is a spiral-shaped, Gram-negative, highly mobile bacterium. Three other human diseases are caused by related Treponema pallidum subspecies, including yaws (subspecies pertenue), pinta (subspecies carateum) and bejel (subspecies endemicum). Unlike subtype pallidum, they do not cause neurological disease. Humans are the only known natural reservoir for subspecies pallidum. It is unable to survive more than a few days without a host. This is due to its small genome (1.14 Mbp) failing to encode the metabolic pathways necessary to make most of its macronutrients. It has a slow doubling time of greater than 30 hours.\",\"question\":\"is a host required for syphilis to survive\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}