{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6621cbed-dede-5c24-bccb-12bbbe03e262","task_key":"default--validation--6621cbed-dede-5c24-bccb-12bbbe03e262","task_revision_id":"1","upstream_id":"","short_description":"can you get to south america by car","config":"default","split":"validation","body":"{\"passage\":\"The Pan-American Highway is a system of roads measuring about 30,000 km (19,000 mi) long that crosses through the entirety of North, Central, and South America, with the sole exception of the Darién Gap. On the South American side, the Highway terminates at Turbo, Colombia near 8°6′N 76°40′W / 8.100°N 76.667°W / 8.100; -76.667. On the Panamanian side, the road terminus is the town of Yaviza at 8°9′N 77°41′W / 8.150°N 77.683°W / 8.150; -77.683. This marks a straight-line separation of about 100 km (60 mi). In between are marshland and forest.\",\"question\":\"can you get to south america by car\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}