{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc408fa2-d1f4-5bce-be3d-c8edc2511bfa","task_key":"default--validation--f652afd8~2de4e3~2d441b~2d9cfb~2d2e2d170df2d4","task_revision_id":"1","upstream_id":"f652afd8-e4e3-441b-9cfb-2e2d170df2d4","short_description":"Who was part of the treaty that allowed the French to occupy the city?","config":"default","split":"validation","body":"{\"passage\":\"It obtained city rights in 1163 from Count Philip of Flanders. The Battle of Nieuwpoort, between the Dutch and the Spanish, happened here in 1600. The city was a Dunkirker base. Painter Victor Boucquet made two of the altar-pieces for the great church in the 17th century. The city was occupied by French forces for six years between 1757 and 1763, as part of the conditions of the Second Treaty of Versailles between France and Austria. A large waterworks infrastructure project called the Ganzepoot  was constructed in Nieuwpoort in the 19th century to drain the polders and channel water in and around the town and to the North Sea. During the Battle of the Yser, part of the First Battle of Ypres in World War I, Hendrik Geeraert opened the sluice gates on the mouth of the river Yser twice to flood the lower lying land, thus halting the German advance.\",\"question\":\"Who was part of the treaty that allowed the French to occupy the city?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}