{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7c734745-340e-51e5-86ce-60ea85fbd8d1","task_key":"default--validation--7c734745-340e-51e5-86ce-60ea85fbd8d1","task_revision_id":"1","upstream_id":"","short_description":"did north korea make it to the world cup","config":"default","split":"validation","body":"{\"passage\":\"North Korea surprised with a good showing at their World Cup debut, reaching the quarter-finals in 1966, beating Italy in the group stage, being the first Asian team in history to make it past the group stage. During the 2006 World Cup Qualifiers, controversy arose when the team's supporters rioted, interfering with the opponents' safe egress from the stadium, because of North Korea's failure to qualify. In 2009, the team qualified for the 2010 FIFA World Cup, the second World Cup appearance in their history. North Korea has qualified for the AFC Asian Cup four times; in 1980, when they finished fourth, in 1992, 2011 and in 2015. The current team is composed of both native North Koreans and Chongryon-affiliated Koreans born in Japan.\",\"question\":\"did north korea make it to the world cup\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}