{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d2d202e0-8c32-5d6c-87fe-b88564fdf430","task_key":"default--validation--4846be15~2dad6c~2d46fb~2db795~2d069429a22c07","task_revision_id":"1","upstream_id":"4846be15-ad6c-46fb-b795-069429a22c07","short_description":"Which ship was destroyed at La Hogue?","config":"default","split":"validation","body":"{\"passage\":\"In 1688 the most powerful navies were the French, English, and Dutch; the Spanish and Portuguese navies had suffered serious declines in the 17th century. The largest French ships of the period were the Soleil Royal and the Royal Louis. Each rated for 120 guns, they never carried their full complement. These ships were too large for practical purposes. The former only sailed on one campaign and was destroyed at La Hogue; the latter languished in port until sold in 1694. By the 1680s, French ship-design was at least equal to its English and Dutch counterparts, and by the Nine Years' War the French fleet had surpassed ships of the Royal Navy, whose designs stagnated in the 1690s. Innovation in the Royal Navy, however, did not cease. At some stage in the 1690s, for example, English ships began to employ the steering wheel, greatly improving their performance, particularly in heavy weather.\",\"question\":\"Which ship was destroyed at La Hogue?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}