{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d70431c5-6449-5523-a952-e72fc6fbc047","task_key":"default--validation--d70431c5-6449-5523-a952-e72fc6fbc047","task_revision_id":"1","upstream_id":"","short_description":"is the prostate part of the endocrine system","config":"default","split":"validation","body":"{\"passage\":\"The endocrine system is a chemical messenger system consisting of hormones, the group of glands of an organism that carry those hormones directly into the circulatory system to be carried towards distant target organs, and the feedback loops of homeostasis that the hormones drive. In humans, the major endocrine glands are the thyroid gland and the adrenal glands. In vertebrates, the hypothalamus is the neural control center for all endocrine systems. The field of study dealing with the endocrine system and its disorders is endocrinology, a branch of internal medicine.\",\"question\":\"is the prostate part of the endocrine system\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}