{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a8bd0cf7-242f-51ec-a46a-3727ca0c9ccd","task_key":"default--validation--a8bd0cf7-242f-51ec-a46a-3727ca0c9ccd","task_revision_id":"1","upstream_id":"","short_description":"does the clock stop when you run out of bounds in the nfl","config":"default","split":"validation","body":"{\"passage\":\"Upon kickoff, the clock is started when a member of the receiving team touches the ball, or, if the member of the receiving team touches the ball in their end zone, carries the ball out of the end zone. The clock is stopped when that player is tackled or goes out of bounds. (The clock never starts if the receiving team downs the ball in their own end zone for a touchback.) The clock is then restarted when the offense snaps the ball for their first play and continues to run unless one of the following occurs, in which case the clock is stopped at the end of the play and restarts at the next snap unless otherwise provided:\",\"question\":\"does the clock stop when you run out of bounds in the nfl\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}