{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"bb9fd671-7d86-5886-8696-57bf28b26b3d","task_key":"default--validation--bb9fd671-7d86-5886-8696-57bf28b26b3d","task_revision_id":"2","upstream_id":"","short_description":"does bailey die in a dog's purpose","config":"default","split":"validation","body":"{\"passage\":\"Later, at a game watched by scouts, Ethan is offered a scholarship to Michigan State, but that night a vindictive classmate named Todd throws a lit firecracker into Ethan's house as a prank, which unintentionally results in a house fire. Bailey alerts Ethan, who goes to save his mother. Unable to get out of the door, they head out through his mother's bedroom window upstairs. Ethan first lowers her with her sheets to the neighbors below, then saves Bailey. However, he drops his rope and must jump, badly fracturing his leg and ending his athletic scholarship. Bailey attacks Todd, who is arrested by the police when firecrackers fall out of his pocket. Now, Ethan must go to an agricultural school where he will learn to take over his grandparents' farm. Falling into depression, Ethan breaks off his romance with Hannah before leaving for college, while Bailey stays with Ethan's grandparents. Sometime afterward, an aged Bailey is put to sleep at the veterinarian's office.\",\"question\":\"does bailey die in a dog's purpose\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}