{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"523a17b2-20f0-548e-9b46-2650ec2dae41","task_key":"default--validation--523a17b2-20f0-548e-9b46-2650ec2dae41","task_revision_id":"1","upstream_id":"","short_description":"are eyes one of the organs of our body","config":"default","split":"validation","body":"{\"passage\":\"The human eye is an organ which reacts to light and pressure. As a sense organ, the mammalian eye allows vision. Human eyes help to provide a three dimensional, moving image, normally coloured in daylight. Rod and cone cells in the retina allow conscious light perception and vision including color differentiation and the perception of depth. The human eye can differentiate between about 10 million colors and is possibly capable of detecting a single photon.\",\"question\":\"are eyes one of the organs of our body\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}