{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7d3a6a39-062c-5161-879e-f12b5afc04c2","task_key":"default--validation--7d3a6a39-062c-5161-879e-f12b5afc04c2","task_revision_id":"1","upstream_id":"","short_description":"is cedar oil the same as cedarwood oil","config":"default","split":"validation","body":"{\"passage\":\"Cedar oil, also known as cedarwood oil, is an essential oil derived from various types of conifers, most in the pine or cypress botanical families. It is produced from the foliage, and sometimes the wood, roots, and stumps which have been left after cutting of trees for timber extraction. It has many uses in medicine, art, industry and perfumery, and while the characteristics of oils derived from various species may themselves vary, all have some degree of bactericidal and pesticidal effects.\",\"question\":\"is cedar oil the same as cedarwood oil\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}