{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"778233ad-b6da-5b56-af8e-243a678ca8fd","task_key":"default--validation--778233ad-b6da-5b56-af8e-243a678ca8fd","task_revision_id":"2","upstream_id":"","short_description":"were there any survivors in the pompeii eruption","config":"default","split":"validation","body":"{\"passage\":\"Temples, houses, bridges, and roads were destroyed. It is believed that almost all buildings in the city of Pompeii were affected. In the days after the earthquake, anarchy ruled the city, where theft and starvation plagued the survivors. In the time between 62 and the eruption in 79, some rebuilding was done, but some of the damage had still not been repaired at the time of the eruption. Although it is unknown how many, a considerable number of inhabitants moved to other cities within the Roman Empire while others remained and rebuilt.\",\"question\":\"were there any survivors in the pompeii eruption\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}