{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"dfc71574-1c80-5a8a-91a0-e5ad0ffc191d","task_key":"default--validation--dfc71574-1c80-5a8a-91a0-e5ad0ffc191d","task_revision_id":"2","upstream_id":"","short_description":"has czech republic ever won the world cup","config":"default","split":"validation","body":"{\"passage\":\"Throughout the World Cup history, Brazil became the team's historical rival. The two countries have met each other five times but the Czechs (always as Czechoslovakia) never managed to win, with three victories for the Brazilian side and two draws. Two other historical opponents in the finals were (West) Germany and Italy with three encounters each: Czechoslovakia won, drew and lost once against the Germans and the matches against Italy all ended in a defeat.\",\"question\":\"has czech republic ever won the world cup\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}