{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ce27c31-4e2b-5808-9b1c-a3716495a036","task_key":"default--validation--6a1259c1~2d5a0a~2d4ca1~2db189~2d7964b0524ae9","task_revision_id":"1","upstream_id":"6a1259c1-5a0a-4ca1-b189-7964b0524ae9","short_description":"Was the population higher pre-war or post-war?","config":"default","split":"validation","body":"{\"passage\":\"The Treaty of Karlowitz, signed in January 1699, confirmed the Venetian possession of Kephalonia, and the Morea with the island of Aigina, which became organized as the \\\"Kingdom of the Morea\\\" , divided into four provinces: Romania, with seat at Nafplion , Laconia, with seat at Monemvasia , Messenia, with seat at Navarino, and Achaea, with seat at Patras . The war however had created a demographic and economic crisis in the Peloponnese. According to the first census conducted by the Venetians, there were 86,468 people in the peninsula compared to a pre-war population of around 200,000. Although the Venetians managed to restore some prosperity - the population allegedly rose to some 250,000 by 1708, probably driven by immigration - they failed to win the trust of their Greek Orthodox subjects, who were used to a relative autonomy under the Turks and resented the Venetian bureaucracy. The Venetians also launched a great fortification project throughout the Morea, whose results can still be seen today. Nevertheless, Venice itself was too weakened to effectively assert its authority, and in 1715 a swift Ottoman campaign  reclaimed the Morea.\",\"question\":\"Was the population higher pre-war or post-war?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}