{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4adfcbd2-89ee-549e-a122-1d28ad27de08","task_key":"default--validation--4adfcbd2-89ee-549e-a122-1d28ad27de08","task_revision_id":"1","upstream_id":"","short_description":"do both male and female bighorn sheep have horns","config":"default","split":"validation","body":"{\"passage\":\"Bighorn sheep are named for the large, curved horns borne by the rams (males). Ewes (females) also have horns, but they are shorter with less curvature. They range in color from light brown to grayish or dark, chocolate brown, with a white rump and lining on the backs of all four legs. Males typically weigh 58--143 kg (128--315 lb), are 90--105 cm (35--41 in) tall at the shoulder, and 1.6--1.85 m (63--73 in) long from the nose to the tail. Females are typically 34--91 kg (75--201 lb), 75--90 cm (30--35 in) tall, and 1.28--1.58 m (50--62 in) long. Male bighorn sheep have large horn cores, enlarged cornual and frontal sinuses, and internal bony septa. These adaptations serve to protect the brain by absorbing the impact of clashes. Bighorn sheep have preorbital glands on the anterior corner of each eye, inguinal glands in the groin, and pedal glands on each foot. Secretions from these glands may support dominance behaviors.\",\"question\":\"do both male and female bighorn sheep have horns\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}