{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1a0e8058-7496-598f-8fb1-a58ab4e29a27","task_key":"default--validation--1a0e8058-7496-598f-8fb1-a58ab4e29a27","task_revision_id":"1","upstream_id":"","short_description":"does the mother die in how i met your mother","config":"default","split":"validation","body":"{\"passage\":\"The story of how Ted met The Mother is the framing device behind the series; many facts about her are revealed throughout the series, including the fact that Ted once unwittingly owned her umbrella before accidentally leaving it behind in her apartment. Ted and The Mother meet at the Farhampton train station following Barney Stinson (Neil Patrick Harris) and Robin Scherbatsky's (Cobie Smulders) wedding; this scene is shown in ``Last Forever'', the series finale. The Mother's death from an unspecified terminal illness in 2024, also revealed in the series finale, received a mixed reaction from fans.\",\"question\":\"does the mother die in how i met your mother\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}