{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"881b742a-db04-534b-b975-e77196d49ad1","task_key":"default--validation--881b742a-db04-534b-b975-e77196d49ad1","task_revision_id":"1","upstream_id":"","short_description":"do you have to use all the numbers on countdown","config":"default","split":"validation","body":"{\"passage\":\"The contestant in control chooses six of 24 shuffled face-down number tiles, arranged into two groups: 20 ``small numbers'' (two each of 1 through 10), and four ``large numbers'' of 25, 50, 75 and 100. Some special episodes replace the large numbers with 12, 37, 62 and 87. The contestant decides how many large numbers are to be used, from none to all four, after which the six tiles are randomly drawn and placed on the board. A random three-digit target number is then generated by an electronic machine, affectionately known as ``CECIL'' (which stands for Countdown's Electronic Calculator In Leeds). The contestants have 30 seconds to work out a sequence of calculations with the numbers whose final result is as close to the target number as possible. They may use only the four basic operations of addition, subtraction, multiplication and division, and do not have to use all six numbers. A number may not be used more times than it appears on the board. Fractions are not allowed, and only positive integers may be obtained as a result at any stage of the calculation. As in the letters rounds, any contestant who does not write down their calculations in time must go first, and both contestants must show their work to each other if their results and calculations are identical.\",\"question\":\"do you have to use all the numbers on countdown\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}