{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"37c24982-3463-5d8c-ad1e-c2ddc7685756","task_key":"default--validation--37c24982-3463-5d8c-ad1e-c2ddc7685756","task_revision_id":"1","upstream_id":"","short_description":"does the little girl in the movie crash die","config":"default","split":"validation","body":"{\"passage\":\"Farhad locates Daniel's house and waits in ambush. As he confronts Daniel with his gun in hand, Lara jumps into Daniel's arms, attempting to protect her father with the ``invisible cloak.'' Daniel's wife Elizabeth runs out the front door and watches in horror as Farhad shoots Lara. Daniel clutches his daughter as Fahrad stands shocked as both realized she has not been hit by any bullet. Daniel runs into the house with his wife and daughter, leaving Fahrad outside. Farhad later tells his daughter that he believes the little girl was his guardian angel, preventing him from committing a terrible crime. Dorri is then shown with the box of bullets she had purchased, labeled as blanks.\",\"question\":\"does the little girl in the movie crash die\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}