{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cac70848-83c3-58ed-94cd-d11244459ec9","task_key":"default--validation--94d469e0~2d5d37~2d4b8a~2d8ba2~2d9132fb477182","task_revision_id":"1","upstream_id":"94d469e0-5d37-4b8a-8ba2-9132fb477182","short_description":"What did the city of Bergamo do to avoid this fate?","config":"default","split":"validation","body":"{\"passage\":\"The Sack of Brescia took place on February 18, 1512 during the War of the League of Cambrai. The city of Brescia had revolted against French control, garrisoning itself with Venetian troops. Gaston de Foix, recently arrived to command the French armies in Italy, ordered the city to surrender; when it refused, he attacked it with around 12,000 men. The French attack took place in a pouring rain, through a field of mud; Foix ordered his men to remove their shoes for better traction. The defenders inflicted heavy casualties on the French, but were eventually overrun, suffering 8,000 - 15,000 casualties. The Gascon infantry and landsknechts then proceeded to thoroughly sack the city, massacring thousands of civilians over the next five days. Following this, the city of Bergamo paid some 60,000 ducats to the French to avoid a similar fate.\",\"question\":\"What did the city of Bergamo do to avoid this fate?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}