{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cbb335ee-540d-59c6-b3ab-84516e81def2","task_key":"default--validation--cbb335ee-540d-59c6-b3ab-84516e81def2","task_revision_id":"1","upstream_id":"","short_description":"did scotland win the world cup in 1978","config":"default","split":"validation","body":"{\"passage\":\"After taking a single point from their opening two games, Scotland had to defeat the Netherlands by three clear goals to progress. Despite the Dutch taking the lead, Scotland fought back to win 3--2 with a goal from Kenny Dalglish and two from Archie Gemmill, the second of which is considered one of the greatest World Cup goals ever; Gemmill beat three Dutch defenders before lifting the ball over goalkeeper Jan Jongbloed into the net. The victory was not sufficient to secure a place in the second round, however, as Scotland were eliminated on goal difference for the second successive World Cup. This performance against strong opponents only heightened the frustration at the poor results earlier in the competition. MacLeod initially retained his position, but resigned later that year.\",\"question\":\"did scotland win the world cup in 1978\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}