{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3e922f89-3a7c-565c-b648-89ec5921bf0f","task_key":"default--validation--12551097~2dfa3c~2d4694~2d9cbe~2d545263d5cd8a","task_revision_id":"1","upstream_id":"12551097-fa3c-4694-9cbe-545263d5cd8a","short_description":"What happened first, the death of Sepé Tiaraju or the battle of Caiboaté?","config":"default","split":"validation","body":"{\"passage\":\"The Guarani refused to accept Portuguese rule and refused to leave the mission settlements. In 1754 Spanish and Portuguese military forces were dispatched to force the Guarani to leave the area. There was inconclusive fighting throughout 1754 between Guarani rebels under Sepé Tiaraju and the combined Portuguese and Spanish forces commanded by Freire de Andrade. By the end of 1754 an armistice was signed between the Guarani and the Spanish and Portuguese forces. Hostilities resumed in 1756 when an army of 3,000 Spanish, Portuguese, and native auxiliary soldiers under José de Andonaegui and Freire de Andrade was sent to subdue the Guarani rebels. On February 7, 1756 the leader of the Guarani rebels, Sepé Tiaraju, was killed in a skirmish with Spanish and Portuguese troops. Three days later the Guarani were defeated at the battle of Caiboaté. 1,511 Guarani were killed and 152 taken prisoner, while 4 Spanish and Portuguese were killed and about 30 were wounded. Following the defeat of the Guarani the Jesuit reductions were occupied by Spanish and Portuguese forces.\",\"question\":\"What happened first, the death of Sepé Tiaraju or the battle of Caiboaté?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}