{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04973298-4aa8-5ba6-80aa-4726ae982217","task_key":"default--validation--04973298-4aa8-5ba6-80aa-4726ae982217","task_revision_id":"1","upstream_id":"","short_description":"does 3rd place in the world cup get a medal","config":"default","split":"validation","body":"{\"passage\":\"If the host nation is involved in the third place match, the team generally uses the match to thank the support of their fans (such as the South Korean football team in 2002, and the German football team in 2006. German goalkeeper Oliver Kahn, who had been a reserve to Jens Lehmann during the 2006 tournament, was allowed to retire in the third place playoff by then manager Jürgen Klinsmann. Germany and Portugal fielded strong lineups in that match, after both were narrowly eliminated in their respective semi-finals (Germany and Italy nearly went to a penalty shootout, while Portugal was defeated by the lower-ranked France). For Brazil, the dismal 3--0 loss to the Netherlands in the 2014 third place match, along with the 7-1 semi-final defeat to Germany, led to coach Luiz Felipe Scolari being dismissed. For the Dutch, this was their first bronze medal in the FIFA World Cup.\",\"question\":\"does 3rd place in the world cup get a medal\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}