{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3b9c0ac7-2985-5913-b056-40d559dd6289","task_key":"default--validation--89538aed~2d8b7f~2d483c~2d976b~2dcb5030bc7824","task_revision_id":"1","upstream_id":"89538aed-8b7f-483c-976b-cb5030bc7824","short_description":"Which aired first, Bonnie Prince Charlie, or the Outlander TV series?","config":"default","split":"validation","body":"{\"passage\":\"In literature, apart from Scott's Waverley novels, the best-known books with the Rebellion as a backdrop include Robert Louis Stevenson's novels Kidnapped and Catriona, the Jacobite trilogy by D.K. Broster and in modern times, Diana Gabaldon's Outlander novels. While not strictly related to the '45, the British author Joan Aiken wrote a series of children's books set in an alternative 18th-century Britain where James II was never deposed and his son James III battles constant pro-Hanoverian conspiracies. Significant screen versions include 1948's Bonnie Prince Charlie starring David Niven who summarised it as 'one of those huge, florid extravaganzas that reek of disaster from the start' and Culloden, Peter Watkins' 1964 docu-drama. In addition to the current Outlander TV series, the aftermath of the Rebellion is the theme of the now lost 1966 Dr Who series The Highlanders. Musical references to the '45 are numerous, both in bagpipe music  and in song; the most famous is the Skye Boat Song but there are many others, one collection being the 1960 album Songs of Two Rebellions: The Jacobite Wars of 1715 and 1745 in Scotland by Ewan MacColl and Peggy Seeger.\",\"question\":\"Which aired first, Bonnie Prince Charlie, or the Outlander TV series?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}