{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8326df97-7aa4-5af5-afbc-91c636d04df0","task_key":"default--validation--8326df97-7aa4-5af5-afbc-91c636d04df0","task_revision_id":"1","upstream_id":"","short_description":"does the girl in don take the girl die","config":"default","split":"validation","body":"{\"passage\":\"Verse three takes place five years after the second verse. At this point, Johnny and the girl are now (presumably) married and expecting their first child, and the girl is eventually rushed to the hospital to have her baby delivered. The baby (a boy) is safely delivered, but the doctor informs Johnny that his wife is ``fading fast'' (presumably dying of childbirth complications). Johnny then collapses to his knees and prays to God that his wife survives, even asking that his own life be taken instead of his wife's as long as she's okay. In the music video, it's revealed that Johnny's wife does indeed survive.\",\"question\":\"does the girl in don take the girl die\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}