{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc3f11f6-d2f1-5180-a667-87f79db7c9f2","task_key":"default--validation--4e21cd75~2db5ab~2d41c2~2daa80~2d1ae95d78f4a3","task_revision_id":"1","upstream_id":"4e21cd75-b5ab-41c2-aa80-1ae95d78f4a3","short_description":"What all military equipment did the group have?","config":"default","split":"validation","body":"{\"passage\":\"Couceiro had undertaken a first incursion in 1911 with about 1,000 men, who had formed in groups of 60-70 men. They had left the town of Verín, 12 kilometers from the northern border with Spain, and had marched towards the border. Most of the men were from the region of Trás-os-Montes and were from a diverse array of social classes and skills. There were more than 100 priests in the group. In terms of military equipment, there were only 400 ancient rifles, a few Winchester rifles, and Mauser Pocket Pistols adapted to rifles, to which were added a score of semi-automatic pistols, daggers, and swords. The 1,000 men had crossed the border after a long march in the mountainous region between Bragança and Vinhais, near the present-day Montesinhos National Park. The republican garrison in Bragança had waited for an attack that never came. This is because the royalists had changed their plans and now marched on Vinhais, which had a smaller garrison of men—only eighty infantry, cavalry and border guards. These forces from Vinhais had left the small town and had concentrated on a hill nearby. Negotiations were begun but the military commander of Vinhais refused to join or to surrender. He gave Paiva Couceiro two hours to abandon Portuguese territory.\",\"question\":\"What all military equipment did the group have?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}