{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1dc26747-2396-56e3-b9bb-7646c991a194","task_key":"default--validation--1dc26747-2396-56e3-b9bb-7646c991a194","task_revision_id":"1","upstream_id":"","short_description":"does a bloody mary have alcohol in it","config":"default","split":"validation","body":"{\"passage\":\"In the United States, the Bloody Mary is a common ``Hair of the dog'' drink, reputed to cure hangovers with its combination of a heavy vegetable base (to settle the stomach), salt (to replenish lost electrolytes), and alcohol (to relieve head and body aches). Most medical advice suggests that the alcohol only numbs the discomfort: Only rest, water, and electrolyte replacement can cure a hangover. Nonetheless, Bloody Mary enthusiasts enjoy some relief from the numbing effects of the alcohol, as well as the placebo effect. Its reputation as a restorative beverage contributes to the popularity of the Bloody Mary in the morning and early afternoon, especially at brunches.\",\"question\":\"does a bloody mary have alcohol in it\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}