{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"506723af-c54a-5226-a78e-7cb776ad7fbd","task_key":"default--validation--506723af-c54a-5226-a78e-7cb776ad7fbd","task_revision_id":"1","upstream_id":"","short_description":"do you have to call the pocket in 9 ball","config":"default","split":"validation","body":"{\"passage\":\"In nine-ball, except when a push-out has been invoked, a legal shot consists of striking the cue ball into the lowest numbered object ball on the table and subsequently either pocketing an object ball, or driving any ball (including the cue ball) to any rail, otherwise the shot is a foul . Additional conditions apply for the break shot (see below). Object balls do not have to be pocketed in numerical order; Any ball may be pocketed at any time during the game, so long as the lowest-numbered ball is contacted first by the cue ball. Nine-ball is not a call shot game. The 9-ball itself can be legally pocketed for a win at any turn in the game, intentionally or by chance, including the break shot. Conversely, a player could potentially pocket all of the object balls numbered one through eight during the course of the game and lose after the other player pockets only the nine-ball.\",\"question\":\"do you have to call the pocket in 9 ball\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}