{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4610f444-245c-5fdc-8fb1-940b05dfaaed","task_key":"default--validation--4610f444-245c-5fdc-8fb1-940b05dfaaed","task_revision_id":"1","upstream_id":"","short_description":"does the batter have to move out of the way of a pitch","config":"default","split":"validation","body":"{\"passage\":\"In baseball, hit by pitch (HBP) is a situation in which a batter or his clothing or equipment (other than his bat) is struck directly by a pitch from the pitcher; the batter is called a hit batsman (HB). A hit batsman is awarded first base, provided that (in the plate umpire's judgment) he made an honest effort to avoid the pitch, although failure to do so is rarely called by an umpire. Being hit by a pitch is often caused by a batter standing too close to, or ``crowding'', home plate.\",\"question\":\"does the batter have to move out of the way of a pitch\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}