{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"207e02d3-5aa4-5aef-91db-2381b8ea2180","task_key":"default--validation--207e02d3-5aa4-5aef-91db-2381b8ea2180","task_revision_id":"1","upstream_id":"","short_description":"is bile supposed to be in the stomach","config":"default","split":"validation","body":"{\"passage\":\"Bile is a digestive fluid made by the liver, stored in the gallbladder, and discharged into duodenum after food is ingested to aid in the digestion of fat. Normally, the pyloric sphincter prevents bile from entering the stomach. When the pyloric sphincter is damaged or fails to work correctly, bile can enter the stomach and then be transported into the esophagus as in gastric reflux. The presence of small amounts of bile in the stomach is relatively common and usually asymptomatic, but excessive refluxed bile causes irritation and inflammation.\",\"question\":\"is bile supposed to be in the stomach\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}