{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f8861a8-8df8-5c3e-99e7-f3de8eb0b6ad","task_key":"default--validation--6f8861a8-8df8-5c3e-99e7-f3de8eb0b6ad","task_revision_id":"1","upstream_id":"","short_description":"did spain win the world cup in 2010","config":"default","split":"validation","body":"{\"passage\":\"In the final, Spain, the European champions, defeated the Netherlands (third-time losing finalists) 1--0 after extra time, with Andrés Iniesta's goal in the 116th minute giving Spain their first world title. Spain became the eighth nation to win the tournament and the first European nation to win a World Cup hosted outside its home continent: all previous World Cups held outside Europe had been won by South American nations. As a result of their win, Spain represented the World in the 2013 FIFA Confederations Cup. Host nation South Africa, 2006 champions Italy and 2006 runners-up France were all eliminated in the first round of the tournament. It was the first time that the hosts had been eliminated in the first round. New Zealand, with their three draws, were the only undefeated team in the tournament, but they were also eliminated in the first round.\",\"question\":\"did spain win the world cup in 2010\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}