{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"663e34d7-4713-536b-bb5a-63753bb7fbba","task_key":"default--validation--f582a020~2dadf5~2d4489~2da18c~2d3cdf55aba27d","task_revision_id":"1","upstream_id":"f582a020-adf5-4489-a18c-3cdf55aba27d","short_description":"Which happened first, the Russians blocked Azov or the siege was lifted?","config":"default","split":"validation","body":"{\"passage\":\"The first Azov campaign began in the spring of 1695. Peter the Great ordered his army  to advance towards Azov. The army comprised crack regiments and the Don Cossacks and was divided into three units under the command of Franz Lefort, Patrick Gordon and Avtonom Golovin. Supplies were shipped down the Don from Voronezh.In 1693 the Ottoman garrison of the fortress was 3,656, of whom 2,272 were Janissaries.Between June 27-July 5 the Russians blocked Azov from land but could not control the river and prevent resupply. After two unsuccessful attacks on August 5 and September 25, the siege was lifted on October 1. Another Russian army  under the command of Boris Sheremetev set out for the lower reaches of the Dnieper to take the Ottoman forts there. The main fort at Gazi-Kerman was taken when its powder magazine blew up, as well as Islam-Kerman, Tagan and Tavan, but the Russians were not able to hold the area and withdrew most of their forces. By the Treaty of Constantinople  the remaining Russians were withdrawn and the lower Dnieper was declared a demilitarized zone.\",\"question\":\"Which happened first, the Russians blocked Azov or the siege was lifted?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}