{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8bfe9810-4e6c-5c57-8df3-bfd52956e688","task_key":"default--validation--42e22a86~2dad52~2d4fd6~2d8c55~2d417064bc5f27","task_revision_id":"1","upstream_id":"42e22a86-ad52-4fd6-8c55-417064bc5f27","short_description":"What year did production begin on the Orlogsværftet producing eight OV-flying…","config":"default","split":"validation","body":"{\"passage\":\"Since 1912 the Royal Danish Navy has operated aircraft either as a functional part of the navy or as flights conducted by the Royal Danish Air Force. Aviation pioneer Robert Svendsen purchased the first aircraft, a Henry Farman, and gave it to the navy who subsequently named it Glenten . Later the same year, a private funding effort made it possible to purchase two Donnet-Leveque flying boats named Maagen  and Ternen . At the outbreak of World War One the navy had two operational flying boats and five educated pilots making it possible to make daily reconnaissance flights over the Sound, monitoring German mine-laying activities. From 1914 to 1917, the Orlogsværftet  produced eight OV-flying boats and in 1915 and 1916 two naval flying stations were established in Copenhagen and Nyborg, mainly focusing on the two international seaways Øresund and Storebælt. After the war the Danish production of aircraft was stopped due to several crashes and an international surplus of warplanes. Following British advice, five Avro 504 were purchased for training purposes and based in Ringsted between the two important straits.\",\"question\":\"What year did production begin on the Orlogsværftet producing eight OV-flying boats?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}