{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed90ad2c-abf2-5808-9069-cfa5b826438e","task_key":"default--validation--ed90ad2c-abf2-5808-9069-cfa5b826438e","task_revision_id":"1","upstream_id":"","short_description":"was poland part of the league of nations","config":"default","split":"validation","body":"{\"passage\":\"The League's greatest extent was from 28 September 1934 (when Ecuador joined) to 23 February 1935 (when Paraguay withdrew) with 58 members. At this time, only Costa Rica (22 January 1925), Brazil (14 June 1926), Japan (27 March 1933) and Germany (19 September 1933) had withdrawn and only Egypt was left to join (on 26 May 1937). The members (listed from earliest joining and alphabetically if they joined on the same day) at this time were Argentina, Australia, Belgium, Bolivia, the British Empire, Canada, Chile, China, Colombia, Cuba, Czechoslovakia, Denmark, El Salvador, France, Greece, Guatemala, Haiti, Honduras, India, Italy, Liberia, the Netherlands, New Zealand, Nicaragua, Norway, Panama, Paraguay, Persia/Iran, Peru, Poland, Portugal, Romania, Siam, South Africa, Spain, Sweden, Switzerland, Uruguay, Venezuela, Yugoslavia, Austria, Bulgaria, Finland, Luxembourg, Albania, Estonia, Latvia, Lithuania, Hungary, the Irish Free State, Ethiopia, the Dominican Republic, Mexico, Turkey, Iraq, the Soviet Union, Afghanistan, and Ecuador.\",\"question\":\"was poland part of the league of nations\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}