{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"795fd934-24e1-550e-b860-78f730f92bec","task_key":"default--validation--795fd934-24e1-550e-b860-78f730f92bec","task_revision_id":"1","upstream_id":"","short_description":"does speed racer ever find out racer x is his brother","config":"default","split":"validation","body":"{\"passage\":\"Throughout the course of Speed Racer, Racer X's identity is constantly revealed to the audience in almost every episode in which he appears, while Speed is unaware of it. Speed starts to suspect that Racer X might, in fact, be his estranged older brother in the ``Challenge of the Masked Racer'' saga (episodes 3 and 4). Speed finds out that Racer X is his long lost brother near the end of the series in ``The Trick Race''.\",\"question\":\"does speed racer ever find out racer x is his brother\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}