{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"73279c1b-5977-5fc7-8023-79210250642e","task_key":"default--validation--4c5e5184~2d99f5~2d4832~2dbf30~2d6e47233464fb","task_revision_id":"1","upstream_id":"4c5e5184-99f5-4832-bf30-6e47233464fb","short_description":"HO wmany troops arived from Cuba?","config":"default","split":"validation","body":"{\"passage\":\"The Ogaden War was a Somali military offensive between July 1977 and March 1978 over the disputed Ethiopian region Ogaden starting with the Somali Democratic Republic's invasion of Ethiopia. The Soviet Union disapproved of the invasion and ceased its support of Somalia to instead start supporting Ethiopia, whereas the United States conversely ceased its support of Ethiopia and started supporting Somalia. Ethiopia was saved from a major defeat and a permanent loss of territory due to a massive airlift of military supplies , the arrival of 16,000 Cuban troops, 1,500 Soviet advisors and 2 brigades from South Yemen, also airlifted to reinforce Harar. The Ethiopians prevailed at Harar, Dire Dawa, Jijiga and began to push the Somalis out of the Ogaden systematically. By March 1978, the Ethiopians had captured almost all of the Ogaden, prompting the defeated Somalis to give up their claim to the region. With 1/3 of the initial Somali National Army invasion force killed and 1/2 of the Somali Airforce destroyed, the war left Somalia with a disorganized and demoralized army and an angry population. All of these conditions led to a revolt in the army which eventually spiraled into a civil war and Somalia's current situation.\",\"question\":\"HO wmany troops arived from Cuba?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}