{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50286282-2e2f-5e76-9580-0eaafc61800a","task_key":"default--validation--50286282-2e2f-5e76-9580-0eaafc61800a","task_revision_id":"1","upstream_id":"","short_description":"has arkansas ever won a national championship in any sport","config":"default","split":"validation","body":"{\"passage\":\"In 1957, Frank Broyles was hired as the head football coach and served in that position for 19 years. Broyles' team was awarded the 1964 National Championship by the Football Writers Association of America and the Helms Athletic Foundation. At the time, The AP and UPI both awarded the designation before bowl games, and gave the award to Alabama. However, Alabama lost their bowl game to Texas, while Arkansas won theirs against Nebraska. The FWAA and HAF both awarded their national championship designations to Arkansas, who was the only team to go undefeated through bowl games that year. Both the University of Arkansas and the University of Alabama claimed national championships for the year 1964.\",\"question\":\"has arkansas ever won a national championship in any sport\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}