{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32225c87-50fa-5af1-aa85-3dc4e40d17bd","task_key":"default--validation--f22e69f5~2d578c~2d425d~2dba5e~2d105c7b31c2d6","task_revision_id":"1","upstream_id":"f22e69f5-578c-425d-ba5e-105c7b31c2d6","short_description":"How many years had passed from when the Karnkowski Statues were instated to when…","config":"default","split":"validation","body":"{\"passage\":\"The Gdansk merchants had suffered a great deal from the blockade, especially because of lack of trade. In the meantime, Bathory also wanted to end the siege, as Ivan the Terrible of Muscovy broke a three-year truce in the same year and Muscovy tried to gain control of the eastern territories of the Commonwealth . The siege and all economic restrictions that were passed in the past two years were lifted in return for reparations and recognition of Bathory as the sovereign. Stefan forgave the city's rebellion and again turned Polish trade from Elbing to Danzig. The city, in turn, recognized him as ruler of Poland and promised to pay the large sum of 200,000 złotys and an additional 20,000 repatriation to the abbey of Oliwa in five years. On 26 November 1585 the Karnkowski Statutes from 1570 were lifted, and Danzig again became the most privileged city in the Commonwealth.\",\"question\":\"How many years had passed from when the Karnkowski Statues were instated to when the were lifted?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}