{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"27677efb-6922-576e-b018-9725ee97faad","task_key":"default--validation--e08a599f~2d39cc~2d4d28~2d8092~2d1ccaf367247d","task_revision_id":"1","upstream_id":"e08a599f-39cc-4d28-8092-1ccaf367247d","short_description":"who become the first Duke of franconia, the Würzburg bishops or kings of Bavaria…","config":"default","split":"validation","body":"{\"passage\":\"Franconia is named after the Franks, a Germanic tribe who conquered most of Western Europe by the middle of the 8th century. Despite its name, Franconia is not the homeland of the Franks, but rather owes its name to being partially settled by Franks from the Rhineland during the 7th century AD following the defeat of the Alamanni and Thuringians who had dominated the region earlier. At the beginning of the 10th century a Duchy of Franconia  was established within East Francia, which comprised modern Hesse, Palatinate, parts of Baden-Württemberg and most of today's Franconia. After the dissolution of the so-called Stem duchy of Franconia, the Holy Roman Emperors created the Franconian Circle  in 1500 to embrace the principalities that grew out of the eastern half of the former duchy. The territory of the Franconian Circle roughly corresponds with modern Franconia. The title of a Duke of Franconia was claimed by the Würzburg bishops until 1803 and by the kings of Bavaria until 1918. Examples of Franconian cities founded by Frankish noblemen are Würzburg, first mentioned in the 7th century, Ansbach, first mentioned in 748, and Weissenburg, founded in the 7th century.\",\"question\":\"who become the first Duke of franconia, the Würzburg bishops or kings of Bavaria ?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}