{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e817dfeb-833a-5c83-b37c-f778d754c813","task_key":"default--validation--3896aca7~2d5cf9~2d4c8d~2d913e~2dc0f6f629932a","task_revision_id":"1","upstream_id":"3896aca7-5cf9-4c8d-913e-c0f6f629932a","short_description":"For how many years from the original deadline was the lease extended?","config":"default","split":"validation","body":"{\"passage\":\"In 1997, Russia and Ukraine signed the Partition Treaty, establishing two independent national fleets and dividing armaments and bases between them. Ukraine also agreed to lease major parts of its facilities to the Russian Black Sea Fleet until 2017. However, the treaty appeared to be far from perfect: permanent tensions on the lease details  control continued. The Fleet's main base is still situated in the Crimean port city of Sevastopol. In 2009 the Yushchenko Ukrainian government declared that the lease would not be extended and that the fleet would have to leave Sevastopol by 2017.  In 2010 the Russian leasehold was renegotiated with an extension until 2042 and an option for an additional five years until 2047.\",\"question\":\"For how many years from the original deadline was the lease extended?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}