{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"aec6e613-f2db-53b2-9682-07d2959c0966","task_key":"default--validation--aec6e613-f2db-53b2-9682-07d2959c0966","task_revision_id":"2","upstream_id":"","short_description":"is there going to be any more pirates of the caribbean films","config":"default","split":"validation","body":"{\"passage\":\"Shortly before the release of On Stranger Tides, it was reported that Disney was planning to shoot the fifth and the sixth films back-to-back, although it was later revealed that only the fifth film was in development. On March 4, 2017, director Joachim Rønning stated that Dead Men Tell No Tales was only the beginning of the final adventure, implying that it would not be the last film of the franchise and that a sixth film could be released.\",\"question\":\"is there going to be any more pirates of the caribbean films\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}