{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2101ef3-6974-5ad6-a738-7492403f1894","task_key":"default--validation--e2101ef3-6974-5ad6-a738-7492403f1894","task_revision_id":"1","upstream_id":"","short_description":"does derek shepard die in grey's anatomy","config":"default","split":"validation","body":"{\"passage\":\"In season 11, Derek is involved in a fatal car accident while driving to the airport for his final trip to Washington. He is able to hear and process auditory input, but unable to speak. He is recognized by Winnie, one of the victims of a crash he assisted in earlier, who tells the surgeons that their patient's name is Derek and that he is a surgeon as well. The hospital he was taken to was understaffed and his head injury was not detected quickly enough by the interns on duty that night. Although the neurosurgeon on call is paged multiple times, he takes too long to arrive and Derek is declared brain dead. Police arrive at Meredith's door and take her to see Derek, where she consents to removing him from life support. At the time of his death, Meredith was pregnant with their third child. She gives birth to a daughter whom she names Ellis after her mother.\",\"question\":\"does derek shepard die in grey's anatomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}