{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9e61ccac-b405-585c-b250-ee36de3dc8e6","task_key":"default--validation--9e61ccac-b405-585c-b250-ee36de3dc8e6","task_revision_id":"1","upstream_id":"","short_description":"did australia fight in the battle of the somme","config":"default","split":"validation","body":"{\"passage\":\"On 7 April 1916, I Anzac Corps took up positions in a quiet sector south of Armentières, known as the ``Nursery''. The Australians were spared from participating in the disastrous first day on the Somme, nevertheless within three weeks of the beginning of the Allied offensive, four divisions of the AIF had been committed to the battle. Only the 3rd Division did not take part, having only just recently arrived in England from Australia. The 5th Division, positioned on the left flank of the salient, was the first to see action during the Battle of Fromelles on 19 July 1916, suffering a staggering 5,533 casualties in a single day.\",\"question\":\"did australia fight in the battle of the somme\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}