{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec5450ed-b026-53fb-9c36-a7a8f6147fbb","task_key":"default--validation--ec5450ed-b026-53fb-9c36-a7a8f6147fbb","task_revision_id":"1","upstream_id":"","short_description":"is the esophagus in front of the heart","config":"default","split":"validation","body":"{\"passage\":\"The esophagus (American English) or oesophagus (British English) (/ɪˈsɒfəɡəs/), commonly known as the food pipe or gullet (gut), is an organ in vertebrates through which food passes, aided by peristaltic contractions, from the pharynx to the stomach. The esophagus is a fibromuscular tube, about 25 centimetres long in adults, which travels behind the trachea and heart, passes through the diaphragm and empties into the uppermost region of the stomach. During swallowing, the epiglottis tilts backwards to prevent food from going down the larynx and lungs. The word esophagus is the Greek word οἰσοφάγος oisophagos, meaning ``gullet''.\",\"question\":\"is the esophagus in front of the heart\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}