{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4a9ad19-cce9-5fe0-8176-1d49c21ff752","task_key":"default--validation--d4a9ad19-cce9-5fe0-8176-1d49c21ff752","task_revision_id":"1","upstream_id":"","short_description":"is a king snake immune to rattlesnake venom","config":"default","split":"validation","body":"{\"passage\":\"Kingsnakes use constriction to kill their prey and tend to be opportunistic when it comes to their diet; they will eat other snakes (ophiophagy), including venomous snakes. Kingsnakes will also eat lizards, rodents, birds, and eggs. The common kingsnake is known to be immune to the venom of other snakes and does eat rattlesnakes, but it is not necessarily immune to the venom of snakes from different localities.\",\"question\":\"is a king snake immune to rattlesnake venom\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}