{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b5331262-a708-5085-b81f-5b6144d32aab","task_key":"default--validation--df7d80d5~2d5c58~2d40f9~2da462~2d3040c78f8fe3","task_revision_id":"1","upstream_id":"df7d80d5-5c58-40f9-a462-3040c78f8fe3","short_description":"What event happened first, Spain loosing all territories it had gained since…","config":"default","split":"validation","body":"{\"passage\":\"By late August 1921, Spain lost all the territories it had gained since 1909. Spanish troops were pushed back to Melilla, which was their biggest base in the eastern Rif. Spain still had 14,000 soldiers in Melilla. However, Abd el-Krim ordered his forces not to attack the town. He subsequently told the writer J. Roger-Matthieu that since citizens of other European nations were residing in Melilla, it was feared they would intervene in the war should their citizens come to harm. Other reasons included the dispersal of Rifian fighters from several loosely allied tribes following the victory at Annual; and the arrival in Melilla of substantial reinforcements from the Legion and other Spanish units recalled from operations in western Morocco. By the end of August Spanish forces at Melilla numbered 36,000 under General Jose Sanjurjo and the slow process of recovering the lost territory could begin. Thus the Spanish could keep their biggest base in the eastern Rif. Later Abd el-Krim would admit: \\\"I bitterly regret this order. It was my biggest mistake. All the following tenor of events happened because of this mistake.\\\" By January 1922 the Spanish had retaken their major fort at Monte Arruit  and had reoccupied the coastal plain as far as Tistutin and Batel. The Rifian forces had consolidated their hold of the inland mountains and stalemate was reached. The Spanish military suffered losses even at sea; in March the transport ship Juan de Joanes was sunk in Alhucemas Bay by Riffian coastal batteries, and in August 1923, while shelling Riffian positions, the battleship España ran aground off Cape Tres Forcas and was eventually scrapped in situ. In a bid to break the stalemate, the Spanish military turned to the use of chemical weapons against the Riffians.\",\"question\":\"What event happened first, Spain loosing all territories it had gained since 1909, or the Spanish retaking their major fort at Monte Arruit.\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}