{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"038a47d4-1484-5446-bd6c-90f0f3b9499d","task_key":"default--validation--0361511d~2df9ac~2d4fce~2d9097~2deadaf3d41042","task_revision_id":"1","upstream_id":"0361511d-f9ac-4fce-9097-eadaf3d41042","short_description":"By how many soldiers did William III increase the army in 5 years?","config":"default","split":"validation","body":"{\"passage\":\"After the Restoration Charles II pulled together four regiments of infantry and cavalry, calling them his guards, at a cost of £122,000 from his general budget. This became the foundation of the permanent English Army. By 1685 it had grown to 7,500 soldiers in marching regiments, and 1,400 men permanently stationed in garrisons.  A Monmouth Rebellion in 1685 allowed James II of England to raise the forces to 20,000 men.  There were 37,000 in 1678, when England played a role in the closing stage of the Franco-Dutch War.  After William III of England and Mary II of England accession to the throne England involved itself in the War of the Grand Alliance, primarily to prevent a French invasion restoring James II (Marys father).  In 1689,  William III expanded the army to 74,000, and then to 94,000 in 1694.  Parliament was very nervous, and reduced the cadre to 7000 in 1697.  Scotland and Ireland had theoretically separate military establishments, but they were unofficially merged with the English force.\",\"question\":\"By how many soldiers did William III increase the army in 5 years?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}