{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"245bd864-ab97-5890-ae12-3508a3a25d8b","task_key":"default--validation--245bd864-ab97-5890-ae12-3508a3a25d8b","task_revision_id":"1","upstream_id":"","short_description":"did the broncos beat the seahawks in the super bowl","config":"default","split":"validation","body":"{\"passage\":\"Super Bowl XLVIII was an American football game between the American Football Conference (AFC) champion Denver Broncos and National Football Conference (NFC) champion Seattle Seahawks to decide the National Football League (NFL) champion for the 2013 season. The Seahawks defeated the Broncos 43--8, the largest margin of victory for an underdog and tied for the third largest point differential overall (35) in Super Bowl history with Super Bowl XXVII (1993). It was the first time the winning team scored over 40 points, while holding their opponent to under 10. This became the first Super Bowl victory for the Seahawks and the fifth Super Bowl loss for the Broncos, tied with the New England Patriots for the most of any team. The game was played on February 2, 2014 at MetLife Stadium at the Meadowlands Sports Complex in East Rutherford, New Jersey, the first Super Bowl played outdoors in a cold-weather city and the first Super Bowl to be played on February 2.\",\"question\":\"did the broncos beat the seahawks in the super bowl\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}