{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"edc03097-5177-5422-b128-3d9feac9898f","task_key":"default--validation--edc03097-5177-5422-b128-3d9feac9898f","task_revision_id":"1","upstream_id":"","short_description":"does aslan come back to life in narnia","config":"default","split":"validation","body":"{\"passage\":\"With her greatest adversary dead, the White Witch leaves with her army to prepare for war against the Narnians, convinced that she will win. Lucy, Susan, and a number of mice remove the bonds from Aslan's body; but as the Stone Table breaks they find that his body is gone. To their shock, Aslan reappears alive and well, thanks to a Deeper Magic from before the Dawn of Time. The Witch, having entered Narnia only at the Dawn of Time, had not known of this. Aslan explains that the Deeper Magic is invoked when an innocent willingly offers his life in place of a traitor's, causing death itself to be reversed until the victim is reborn.\",\"question\":\"does aslan come back to life in narnia\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}