{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"700347b1-b41c-5f8b-881d-8407eb76c346","task_key":"default--validation--700347b1-b41c-5f8b-881d-8407eb76c346","task_revision_id":"1","upstream_id":"","short_description":"can you push in a rugby league scrum","config":"default","split":"validation","body":"{\"passage\":\"A key difference between the two sports is that in rugby union both sets of forwards try to push the opposition backwards whilst competing for the ball and thus the team that did not throw the ball into the scrum have some minimal chance of winning the possession. In practice, however, the team with the 'put-in' usually keeps possession (92% of the time with the feed) and put-ins are not straight. Forwards in rugby league do not usually push in the scrum, scrum-halves often feed the ball directly under the legs of their own front row rather than into the tunnel, and the team with the put-in usually retains possession (thereby making the 40/20 rule workable).\",\"question\":\"can you push in a rugby league scrum\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}