{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"acc7a13b-16c5-5328-82ae-e981e6df495e","task_key":"default--validation--acc7a13b-16c5-5328-82ae-e981e6df495e","task_revision_id":"1","upstream_id":"","short_description":"has germany ever won the eurovision song contest","config":"default","split":"validation","body":"{\"passage\":\"Germany first won the contest at the 27th attempt in 1982 in Harrogate, when Nicole won with the song ``Ein bisschen Frieden'' (A Little Peace). The second German victory came 28 years later at the 2010 contest in Oslo, when Lena won with ``Satellite''. Katja Ebstein, who finished third in 1970 and 1971, then second in 1980, is the only performer to have made the top three on three occasions. Germany has a total of 11 top three placements, also finishing second with Lena Valaitis (1981) and twice with the group Wind (1985 and 1987), and finishing third with Mary Roos (1972), Mekado (1994) and Surpriz (1999). Germany has finished last on seven occasions, receiving nul points in 1964, 1965 and 2015.\",\"question\":\"has germany ever won the eurovision song contest\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}