{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a4285fe2-d738-51da-b824-9d64da258d85","task_key":"default--validation--e31e7c31~2dccf7~2d438d~2d8613~2d1b4a88628fad","task_revision_id":"1","upstream_id":"e31e7c31-ccf7-438d-8613-1b4a88628fad","short_description":"Which happened first, Adobe's restrictions lifted or Gnash's overdue removal?","config":"default","split":"validation","body":"{\"passage\":\"The reliance on Adobe for decoding Flash makes its use on the World Wide Web a concern—the completeness of its public specifications are debated, and no complete implementation of Flash is publicly available in source code form with a license that permits reuse. Generally, public specifications are what makes a format re-implementable , and reusable codebases can be ported to new platforms without the endorsement of the format creator. Adobe's restrictions on the use of the SWF/FLV specifications were lifted in February 2009 . However, despite efforts of projects like Gnash, Swfdec and Lightspark, a complete free Flash player is yet to be seen, as of September 2011. For example, Gnash cannot use SWF v10 yet. Notably, Gnash was listed on the Free Software Foundation's high priority list, from at least 2007, to its overdue removal in January 2017. Notable advocates of free software, open standards, and the World Wide Web have warned against the use of Flash: The founder of Mozilla Europe, Tristan Nitot, stated in 2008:\",\"question\":\"Which happened first, Adobe's restrictions lifted or  Gnash's overdue removal?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}