{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4363f23-2ae1-5e8b-b5a2-4ca775027164","task_key":"default--validation--d4363f23-2ae1-5e8b-b5a2-4ca775027164","task_revision_id":"1","upstream_id":"","short_description":"does the goalkeeper count in the offside rule","config":"default","split":"validation","body":"{\"passage\":\"A player is in an 'offside position' if they are in the opposing team's half of the field and also ``nearer to the opponents' goal line than both the ball and the second-last opponent.'' The 2005 edition of the Laws of the Game included a new IFAB decision that stated, ``In the definition of offside position, 'nearer to his opponents' goal line' means that any part of their head, body or feet is nearer to their opponents' goal line than both the ball and the second last opponent. The arms are not included in this definition''. By 2017, the wording had changed to say that, in judging offside position, ``The hands and arms of all players, including the goalkeepers, are not considered.'' In other words, a player is in an offside position if two conditions are met:\",\"question\":\"does the goalkeeper count in the offside rule\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}