{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e3c1b72c-e220-5b24-9707-0981b68bb6fb","task_key":"default--validation--e3c1b72c-e220-5b24-9707-0981b68bb6fb","task_revision_id":"1","upstream_id":"","short_description":"do they live at the end of a quiet place","config":"default","split":"validation","body":"{\"passage\":\"Regan, who was not allowed in the basement previously, sees her father's notes on the creatures and on his experimentation with several different implants. When the creature returns to invade the basement, Regan places the boosted implant on a nearby microphone, magnifying the feedback to ward off the creature. Painfully disoriented, the creature exposes the flesh beneath its armored head, and Evelyn shoots the creature in the head with a shotgun, destroying its head and killing it. The family views a CCTV monitor, showing two creatures attracted by the noise of the shotgun blast approaching the house. With their newly acquired knowledge of the creatures' weakness, the members of the family arm themselves and prepare to fight back.\",\"question\":\"do they live at the end of a quiet place\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}