{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7f0bb40-de10-561f-aede-7636d49184b4","task_key":"default--validation--f7f0bb40-de10-561f-aede-7636d49184b4","task_revision_id":"1","upstream_id":"","short_description":"did glenn die in the walking dead season 6","config":"default","split":"validation","body":"{\"passage\":\"In the seventh season premiere, ``The Day Will Come When You Won't Be'', Abraham is revealed to be Negan's chosen victim; Negan brutally beats him to death with Lucille as the rest of the group watches, horrified. When Daryl strikes Negan in the face, Negan declares that he will need to kill someone else as punishment. He then strikes Glenn with Lucille. After two blows to the head, Glenn sits up, severely brain damaged with a dislocated eye, and mutters ``Maggie, I'll find you'', before Negan repeatedly bludgeons Glenn's skull into a bloody pulp.\",\"question\":\"did glenn die in the walking dead season 6\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}