{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"64d7ad5b-c959-52e5-864d-775ef0b14b5e","task_key":"default--validation--468a72c0~2dbfd0~2d4c02~2d958e~2dc8b2eb4f45ce","task_revision_id":"1","upstream_id":"468a72c0-bfd0-4c02-958e-c8b2eb4f45ce","short_description":"Which were there more of in the second battle, Italians or men of Languedoc?","config":"default","split":"validation","body":"{\"passage\":\"Charles reached Rome in 1265, but was temporarily halted by financial embarrassments. Manfred, however, did not take the field against him until January 1266, when Charles' main army had crossed the Alps. Alarmed by desertions among his followers and fearing further treachery, Manfred sought to bring Charles to battle as swiftly as possible. Charles attempted to turn Manfred's position at Capua by a perilous crossing of the Apennines which wrecked his supply line; but Manfred had intelligence of his move and lay in a strong position across the River Calore, crossed only by one bridge. Charles had divided his cavalry into three \\\"battles\\\". The infantry and the first battle, consisting of 900 Provençals were at the front, commanded by Marshal of France Hugh of Mirepoix and Philip of Montfort, Lord of Castres. Behind them were the second battle, which consisted of 400 Italians and 1,000 men of Languedoc and central France. Charles commanded the second battle in person. Behind them, the third battle consisted of about 700 men from the county of Flanders under Constable of France Gilles II de Trasignies and Robert III of Flanders. Manfred had adopted similar dispositions. His Saracen archers were in the fore. Behind them was the first battle, 1,200 German mercenaries armed in coats of plates, commanded by his cousin Giordano d'Anglano and Galvano of Anglona. The second battle consisted of the Italian mercenaries, about 1,000, and 300 Saracen light horse, commanded by his uncle Galvano Lancia. The third battle, numbering 1,400, were the feudatories of the Kingdom, under Manfred's personal command.\",\"question\":\"Which were there more of in the second battle, Italians or men of Languedoc?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}