{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d7be00c3-b221-534f-9c4b-52fd213e0d6b","task_key":"default--validation--d7be00c3-b221-534f-9c4b-52fd213e0d6b","task_revision_id":"1","upstream_id":"","short_description":"does keith die in season 3 of one tree hill","config":"default","split":"validation","body":"{\"passage\":\"The aftermath of the school shooting and the death of Jimmy Edwards force everyone in Tree Hill to examine their lives. Nathan reassesses his relationship with Haley, while Brooke and Rachel join forces to heal the student body. Dan must deal with the ramifications of killing Keith. Lucas and Peyton consider the implications of their kiss in the library.\",\"question\":\"does keith die in season 3 of one tree hill\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}