{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e214505a-c2aa-549f-82ee-1af27efbed69","task_key":"default--validation--2c64003d~2d6d47~2d4af8~2dbbca~2d4c16cc0faf9e","task_revision_id":"1","upstream_id":"2c64003d-6d47-4af8-bbca-4c16cc0faf9e","short_description":"How many more foot soldiers than horse soldiers were required to handle the…","config":"default","split":"validation","body":"{\"passage\":\"On 16 February 1525, 25 villages belonging to the city of Memmingen rebelled, demanding of the magistrates  improvements in their economic condition and the general political situation. They complained of peonage, land use, easements on the woods and the commons as well as ecclesiastical requirements of service and payment. The city set up a committee of villagers to discuss their issues, expecting to see a checklist of specific and trivial demands. Unexpectedly, the peasants delivered a uniform declaration that struck at the pillars of the peasant-magisterial relationship. Twelve articles clearly and consistently outlined their grievances. The council rejected many of the demands. Historians have generally concluded that the articles of Memmingen became the basis for the Twelve Articles agreed on by the Upper Swabian Peasants Confederation of 20 March 1525. A single Swabian contingent, close to 200 horse and 1,000 foot soldiers, however, could not deal with the size of the disturbance. By 1525, the uprisings in the Black Forest, the Breisgau, Hegau, Sundgau, and Alsace alone required a substantial muster of 3,000 foot and 300 horse soldiers.\",\"question\":\"How many more foot soldiers than horse soldiers were required to handle the uprisings in 1525?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}