{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0f6376a-6ed5-5d03-9563-e909a0dea654","task_key":"default--validation--c0f6376a-6ed5-5d03-9563-e909a0dea654","task_revision_id":"1","upstream_id":"","short_description":"does the dad die in train to busan","config":"default","split":"validation","body":"{\"passage\":\"A blocked track at East Daegu train station forces the survivors to stop and search for another train. In the process, Seok-woo, Seong-kyeong, Su-an, and the homeless man are separated from Yong-guk and Jin-hee. Yon-suk escapes after pushing the train attendant to be killed by the zombies, then does the same with Jin-hee. Heartbroken, Yong-guk stays with Jin-hee and is soon bitten by her. The train conductor starts a locomotive on another track but is also killed by zombies while trying to save Yon-suk. The homeless man sacrifices himself to let Su-an and Seong-kyeong escape with Seok-woo into the train the conductor had activated. They encounter Yon-suk in the motorman's cab, on the verge of turning into a zombie, having been bitten when the train conductor saved him. Seok-woo fights him off, but is himself bitten. He puts Su-an and Seong-kyeong inside the engine room and shares his last words with his daughter before moving outside. As he zombifies, he thinks of the first time he held his daughter in his arms and throws himself off the locomotive with a smile.\",\"question\":\"does the dad die in train to busan\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}