{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2cdb9fd2-6779-5124-90c8-33db2ece8dc2","task_key":"default--validation--7b881f5f~2db818~2d4709~2d85b6~2d9acdb33b746f","task_revision_id":"1","upstream_id":"7b881f5f-b818-4709-85b6-9acdb33b746f","short_description":"How many people did the population decline by from 273 until after the Gothic…","config":"default","split":"validation","body":"{\"passage\":\"The Bishop of Rome, called the Pope, was important since the early days of Christianity because of the martyrdom of both the apostles Simon Peter and Paul of Tarsus there. The Bishops of Rome were also seen (and still are seen by Catholics) as the successors of Peter, who is considered the first Bishop of Rome. The city thus became of increasing importance as the centre of the Catholic Church. After the Decline of the Roman Empire in 476 AD, Rome was first under the control of Odoacer and then became part of the Ostrogothic Kingdom before returning to Byzantine Empire control after the Gothic War (535-554), which devastated the city. Its population declined from more than a million in 210 AD to 500,000 in 273 to 35,000 after the Gothic War (535-554), reducing the sprawling city to groups of inhabited buildings interspersed among large areas of ruins, vegetation, vineyards and market gardens. It is generally thought the population of the city until 300 A.D. was 1 million (estimates range from 2 million to 750,000)  declining to 750-800,000 in 400 A.D., 450-500,000 in 450 A.D. and down to 80-100,000 in 500 A.D. (though it may have been twice this), Rome in Late Antiquity, Bernard Lancon, 2001, pp. 14, 115-119; Rome Profile of a City, Richard Krautheimer, 2000, pp. 4, 65.\",\"question\":\"How many people did the population decline by from 273 until after the Gothic War in 554?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}