{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3b6f7208-0d5c-5adf-a29b-94747ae1079e","task_key":"default--validation--3b6f7208-0d5c-5adf-a29b-94747ae1079e","task_revision_id":"1","upstream_id":"","short_description":"is red grapefruit the same as pink grapefruit","config":"default","split":"validation","body":"{\"passage\":\"The evergreen grapefruit trees usually grow to around 5--6 meters (16--20 ft) tall, although they may reach 13--15 m (43--49 ft). The leaves are glossy, dark green, long (up to 15 centimeters (5.9 in)), and thin. It produces 5 cm (2 in) white four-petaled flowers. The fruit is yellow-orange skinned and generally, an oblate spheroid in shape; it ranges in diameter from 10--15 cm (3.9--5.9 in). The flesh is segmented and acidic, varying in color depending on the cultivars, which include white, pink, and red pulps of varying sweetness (generally, the redder varieties are the sweetest). The 1929 U.S. Ruby Red (of the Redblush variety) has the first grapefruit patent.\",\"question\":\"is red grapefruit the same as pink grapefruit\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}