{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"afdaf9ae-1013-5552-b9b2-a1b01dbc1428","task_key":"default--validation--0b67cac8~2dbbe9~2d46a1~2d9646~2da2e6bcc9b9d7","task_revision_id":"1","upstream_id":"0b67cac8-bbe9-46a1-9646-a2e6bcc9b9d7","short_description":"How many days passed from when the invasion of the First Republic of Armenia…","config":"default","split":"validation","body":"{\"passage\":\"Armenia gave way to communist power in late 1920. The Soviet 11th Red Army's invasion of the First Republic of Armenia started on the 29th of November 1920. The actual transfer of power took place on December 2 in Yerevan, when the Armenian leadership approved an ultimatum presented to it by the Soviet plenipotentiary Boris Legran. Armenia agreed to join the Soviet sphere, while Soviet Russia agreed to protect its remaining territory from the advancing Turkish army. The Soviets also pledged to take steps to rebuild the army, to protect the Armenians and not to persecute non-communists, although the final condition of this pledge was reneged when the Dashnaks were forced out of the country. The Soviet Government proposed the annexation of the Nagorno-Karabagh and Syunik regions of Armenia to Soviet Azerbaijan. This step was strongly rejected by Garegin Nzhdeh, who declared Syunik as a self-governing region on December 25, 1920. In January 1921 Drastamat Kanayan sent a telegram to Njdeh, suggesting allowing the sovietisation of Syunik, through which they could gain the support of the Bolshevik government in solving the problems of the Armenian lands. Njdeh again proved himself as a long-sighted politician, he did not depart from Syunik and continued his struggle against the Red Army and Soviet Azerbaijan.\",\"question\":\"How many days passed from when the invasion of the First Republic of Armenia started to when Syunik was declared as a self-governing region\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}