{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a876af7-cc4d-57ab-ba16-d202d555c1c4","task_key":"default--validation--2a876af7-cc4d-57ab-ba16-d202d555c1c4","task_revision_id":"1","upstream_id":"","short_description":"do all colors of fruit loops taste the same","config":"default","split":"validation","body":"{\"passage\":\"Froot Loops is a brand of sweetened, fruit-flavored breakfast cereal produced by Kellogg's and sold in many countries. The cereal pieces are ring-shaped (hence ``loops'') and come in a variety of bright colors and a blend of fruit flavors (hence ``froot'', a cacography of fruit). However, there is no actual fruit in Froot Loops and they are all the same flavor. Kellogg's introduced Froot Loops in 1963. Originally, there were only red, orange, and yellow loops, but green, purple, and blue were added during the 1990s. Different methods of production are used in the UK where, due to the lack of natural colourings for yellow, red and blue Froot Loops are purple, green and orange, and the loops are also larger in size. Although the marketing side of Kellogg's sold the idea that each individual loop color was a different flavor, Kellogg's has acknowledged that all share the same fruit-blend flavor.\",\"question\":\"do all colors of fruit loops taste the same\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}