{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0d6a23de-b2ef-58c9-8f94-7bd1c195a25e","task_key":"default--validation--0d6a23de-b2ef-58c9-8f94-7bd1c195a25e","task_revision_id":"1","upstream_id":"","short_description":"does rachel dawes die in the dark knight","config":"default","split":"validation","body":"{\"passage\":\"After Batman and Gordon capture the Joker, Rachel and Dent are kidnapped by police officers on mob boss Sal Maroni's (Eric Roberts) payroll, who are working under the Joker's orders. Batman interrogates the Joker and learns that the lives of both Dent and Rachel are at stake. The Joker tells Batman that he must choose which one of them to save and gives him both locations. However, the Joker has switched the addresses, with the intention of orchestrating Dent's downfall. Batman speeds off, believing that he is traveling to Rachel's destination. Both Rachel and Dent are tied up in rooms surrounded with gasoline drums and remote-controlled explosives, with phones attached so they can talk to each other. Rachel tells Dent that she wants to marry him. Batman arrives at Dent's location in time to save him, but Gordon arrives at the other too late, and Rachel is killed in the explosion. The loss of Rachel, in addition to his own disfigurement, drives Dent insane and he becomes the murderous vigilante Two-Face, seeking revenge on those he holds responsible for Rachel's death.\",\"question\":\"does rachel dawes die in the dark knight\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}