{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4669ee46-78f5-5d7d-b5fd-5011db0b20ce","task_key":"default--validation--4669ee46-78f5-5d7d-b5fd-5011db0b20ce","task_revision_id":"1","upstream_id":"","short_description":"is lord of the rings a book series","config":"default","split":"validation","body":"{\"passage\":\"For publication, the book was divided into three volumes to minimize any potential financial loss due to the high cost of type-setting and modest anticipated sales: The Fellowship of the Ring (Books I and II), The Two Towers (Books III and IV), and The Return of the King (Books V and VI plus six appendices). Delays in producing appendices, maps and especially an index led to the volumes being published later than originally hoped -- on 29 July 1954, on 11 November 1954 and on 20 October 1955 respectively in the United Kingdom. In the United States, Houghton Mifflin published The Fellowship of the Ring on 21 October 1954, The Two Towers on 21 April 1955, and The Return of the King on 5 January 1956. The Return of the King was especially delayed due to Tolkien revising the ending and preparing appendices (some of which had to be left out because of space constraints). Tolkien did not like the title The Return of the King, believing it gave away too much of the storyline, but deferred to his publisher's preference. He suggested the title The Two Towers in a deliberately ambiguous attempt to link the unconnected books III and IV, and as such the eponymous towers could be either Orthanc and Barad-dûr, or Minas Tirith and Barad-dûr, or Orthanc and Cirith Ungol.\",\"question\":\"is lord of the rings a book series\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}