{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19ddd2ac-4a0c-5e7e-9fd7-e098f3875c98","task_key":"default--validation--19ddd2ac-4a0c-5e7e-9fd7-e098f3875c98","task_revision_id":"1","upstream_id":"","short_description":"can you eat the black things in bubble tea","config":"default","split":"validation","body":"{\"passage\":\"Tapioca balls (boba) are the prevailing chewy tidbits in bubble tea, but a wide range of other options can be used to add similar texture to the drink. These are usually black due to the brown sugar mixed in with the tapioca. Green pearls have a small hint of green tea flavor and are chewier than the traditional tapioca balls. Jelly comes different shapes: small cubes, stars, or rectangular strips, and flavors such as coconut jelly, konjac, lychee, grass jelly, mango, coffee and green tea available at some shops. Azuki bean or mung bean paste, typical toppings for Taiwanese shaved ice desserts, give the drinks an added subtle flavor as well as texture. Aloe, egg pudding (custard), and sago can be found in most tea houses.\",\"question\":\"can you eat the black things in bubble tea\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}