{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0116aa08-16bd-5079-83af-53c64986baec","task_key":"default--validation--0116aa08-16bd-5079-83af-53c64986baec","task_revision_id":"1","upstream_id":"","short_description":"is the red panda is related to the giant panda","config":"default","split":"validation","body":"{\"passage\":\"At various times, it has been placed in the Procyonidae, Ursidae, with Ailuropoda (giant panda) in the Ailuropodinae (until this family was moved into the Ursidae), and into its own family, the Ailuridae. This uncertainty comes from difficulty in determining whether certain characteristics of Ailurus are phylogenetically conservative or are derived and convergent with species of similar ecological habits.\",\"question\":\"is the red panda is related to the giant panda\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}