{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"146489dd-fea3-5aa0-89e8-5a4949fe43c1","task_key":"default--validation--146489dd-fea3-5aa0-89e8-5a4949fe43c1","task_revision_id":"1","upstream_id":"","short_description":"did the yankees win the world series in 2001","config":"default","split":"validation","body":"{\"passage\":\"The 2001 World Series was the championship series of Major League Baseball's (MLB) 2001 season. The 97th edition of the World Series, it was a best-of-seven playoff between the National League (NL) champion Arizona Diamondbacks and the three-time defending World Series champions and American League (AL) champion New York Yankees. The Diamondbacks defeated the Yankees, four games to three to win the series. Considered one of the greatest World Series of all time, memorable aspects included two extra-inning games and three late-inning comebacks. Diamondbacks pitchers Randy Johnson and Curt Schilling were both named World Series Most Valuable Players.\",\"question\":\"did the yankees win the world series in 2001\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}