{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a965709-cff4-5c61-9498-7a2aede8e6cb","task_key":"default--validation--2a965709-cff4-5c61-9498-7a2aede8e6cb","task_revision_id":"1","upstream_id":"","short_description":"is there an insect called a walking stick","config":"default","split":"validation","body":"{\"passage\":\"The Phasmatodea (also known as Phasmida or Phasmatoptera) are an order of insects, whose members are variously known as stick insects in Europe and Australasia; stick-bugs, walking sticks or bug sticks in the United States and Canada; or as phasmids, ghost insects or leaf insects (generally the family Phylliidae). The group's name is derived from the Ancient Greek φάσμα phasma, meaning an apparition or phantom, referring to the resemblance of many species to sticks or leaves. Their natural camouflage makes them difficult for predators to detect, but many species have a secondary line of defence in the form of startle displays, spines or toxic secretions. The genus Phobaeticus includes the world's longest insects.\",\"question\":\"is there an insect called a walking stick\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}