{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3723da09-0a88-5e9c-971e-8a666279adc3","task_key":"default--validation--96aca520~2df9ff~2d4be7~2d93cf~2ddece4b1817aa","task_revision_id":"1","upstream_id":"96aca520-f9ff-4be7-93cf-dece4b1817aa","short_description":"What happened second: captured on Jolo or Philippine soldiers raided?","config":"default","split":"validation","body":"{\"passage\":\"On 31 August, 2000, American citizen and Muslim convert Jeffrey Schilling from Oakland, California was captured on Jolo while visiting a terrorist camp with his new wife, Ivy Osani , whom he had met online. ASG demanded a $10 million ransom. Rebels also sarcastically threatened to behead him in 2001 as a \\\"birthday present\\\" to then Philippine President Gloria Macapagal Arroyo, who responded by declaring \\\"all-out war\\\" on them. The beheading threat was withdrawn after Schilling's mother, Carol, flew to the Philippines and appealed for mercy on local radio. On 12 April, 2001, Philippine soldiers raided a rebel camp and rescued the American. The United States praised the Philippine government for freeing Schilling. Many commentators have been critical of Schilling, who claims to have walked willingly into the camp after he was invited by his wife's cousin, a member of Abu Sayyaf. Schilling was one of more than forty hostages taken by Abu Sayyaf in 2000, including twenty-one tourists and workers seized in a raid on Sipadan diving resort in neighbouring Malaysia. Many of the hostages were released after Libya paid millions of dollars. A Libyan official stated that Schilling had visited the Jolo camp often before his capture. Philippine intelligence sources say he was interested in selling military equipment to the rebels, while the bandits accused him of being a CIA agent. Abu Sayyaf threatened several times to kill Schilling. At one stage, Schilling reportedly went on a hunger strike to win his freedom.\",\"question\":\"What happened second: captured on Jolo or Philippine soldiers raided?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}