{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c0a5883-d365-5ba4-a0d0-57997805ae2c","task_key":"default--validation--5c0a5883-d365-5ba4-a0d0-57997805ae2c","task_revision_id":"1","upstream_id":"","short_description":"are there other kinds of ketchup besides tomato","config":"default","split":"validation","body":"{\"passage\":\"In the United Kingdom, preparations of ketchup were historically and originally prepared with mushrooms as a primary ingredient, rather than tomatoes. Ketchup recipes began to appear in British and then American cookbooks in the 18th century. In a 1742 London cookbook, the fish sauce had already taken on a very British flavor, with the addition of shallots and mushrooms. The mushrooms soon became the main ingredient, and from 1750 to 1850 the word ketchup began to mean any number of thin dark sauces made of mushrooms or even walnuts. In the United States, mushroom ketchup dates back to at least 1770, and was prepared by British colonists in ``English speaking colonies in North America''. In contemporary times, mushroom ketchup is available in the UK, although it is not a commonly used condiment.\",\"question\":\"are there other kinds of ketchup besides tomato\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}