{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d33dcae3-a7f0-54e3-a66a-566743757316","task_key":"default--validation--d33dcae3-a7f0-54e3-a66a-566743757316","task_revision_id":"1","upstream_id":"","short_description":"does arnie die in what eating gilbert grape","config":"default","split":"validation","body":"{\"passage\":\"Following Arnie's 18th birthday party, Bonnie climbs the stairs to her bedroom for the first time since her husband's suicide. Arnie later tries to wake her but discovers that she has died. The children, not willing to let their mother become the joke of the town by having her corpse lifted from the house by crane, empty their family home of possessions and set it on fire. A year later, Gilbert describes what happened to his family after his mother's death, as Gilbert and his brother Arnie wait by the side of a road for Becky, who arrives with her grandmother, and picks them up.\",\"question\":\"does arnie die in what eating gilbert grape\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}