{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3cb86692-dfa8-5ddc-a2b9-134a0c9b1a15","task_key":"default--validation--3cb86692-dfa8-5ddc-a2b9-134a0c9b1a15","task_revision_id":"1","upstream_id":"","short_description":"did india qualify for football world cup 2018","config":"default","split":"validation","body":"{\"passage\":\"By March 2015, after not playing any matches, India reached their lowest FIFA ranking position of 173. A couple months prior, Stephen Constantine was re-hired as the head coach after first leading India more than a decade before. Constantine's first major assignment back as the India head coach were the 2018 FIFA World Cup qualifiers. After making it through the first round of qualifiers, India crashed out during the second round, losing seven of their eight matches and thus, once again, failed to qualify for the World Cup.\",\"question\":\"did india qualify for football world cup 2018\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}