{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36c225db-37f7-59e9-9d2c-389c16dd84a4","task_key":"default--validation--55197c09~2dfea5~2d4e8b~2d8303~2d9cd7d221dc35","task_revision_id":"1","upstream_id":"55197c09-fea5-4e8b-8303-9cd7d221dc35","short_description":"How many months did the Republic of Aras last?","config":"default","split":"validation","body":"{\"passage\":\"In response to a border proposal by Sir John Oliver Wardrop—British Chief Commissioner in the South Caucasus—that would have assigned Nakhchivan to Armenia, Azeris of Nakhchivan revolted under the leadership of local landowner Jafargulu Khan Nakhchivanski in December 1918 and declared the independent Republic of Aras, with its capital in Nakhchivan. The republic, which was essentially subordinate to Azerbaijan, continued to exist until May 1919, when Armenian troops led by Drastamat Kanayan advanced into it to gain control over the region. They managed to capture the city of Nakhchivan in June 1919 and destroy the Republic of Aras, but afterwards fought combined regular Azeri and Ottoman troops, which reinstated Azeri control over the city in July. On 10 August 1919 a cease-fire was signed. American Commission to Negotiate Peace telegram dating 1919 speaking on the conflict,\",\"question\":\"How many months did the Republic of Aras last?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}