{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"971e6660-2691-5f90-a493-c222b266498f","task_key":"default--validation--971e6660-2691-5f90-a493-c222b266498f","task_revision_id":"1","upstream_id":"","short_description":"does duke die in gi joe 2 retaliation 2013","config":"default","split":"validation","body":"{\"passage\":\"Following the events of The Rise of Cobra, Duke (Channing Tatum) has become the leader of the G.I. Joe unit, which is framed for stealing nuclear warheads from Pakistan by Zartan (Arnold Vosloo), who is impersonating the President of the United States (Jonathan Pryce). The unit is subsequently eliminated in a military air strike with Duke as one of the casualties. The only survivors are Roadblock (Dwayne Johnson), Flint (D.J. Cotrona), and Lady Jaye (Adrianne Palicki).\",\"question\":\"does duke die in gi joe 2 retaliation 2013\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}