{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b69bb3b4-6e28-5500-a525-cacabe97bc43","task_key":"default--validation--df753f1e~2d1317~2d4f59~2d9c7b~2dcf18f3d343c7","task_revision_id":"1","upstream_id":"df753f1e-1317-4f59-9c7b-cf18f3d343c7","short_description":"How many days did the battle between Chen Dong and Xu Hai last?","config":"default","split":"validation","body":"{\"passage\":\"By this time Hu Zongxian had almost collected his strength: Lu Tang had won a decisive victory in Taizhou south of Ningbo and came back to help deal with Xu Hai; while 6000 fresh aboriginal soldiers from Baojing and Yongshun were on its way to come to Hu Zongxian's aid. The imperial inspector Zhao Wenhua reiterated the emperor's wishes that surrender was not an option, so Hu Zongxian made a show of receiving Xu Hai's surrender while waiting for the opportune moment to strike. In the meantime Xu Hai had settled in the Shen Family Estate  of Pinghu, where he recruited up to 300 new followers by hosting banquets for his neighbours, adding to the thousand or more raiders still under his command and remnants of Chen Dong's group next to the estate. He grew increasingly recalcitrant, refusing an invitation to an official Mid-Autumn party and even killing an envoy from Hu Zongxian. In late September, reinforcements from Baojing and Yongshun arrived and began small-scale skirmishes around the Shen Family Estate. Before commencing the final attack, Hu Zongxian persuaded his captive Chen Dong to write a letter to his followers encamped next to Xu Hai's forces, warning them that Xu Hai was conspiring with government troops to wipe them out in a pincer operation. This provoked Chen Dong's men into attacking Xu Hai's group on September 27, upon which government forces entered the fray from all directions, killing indiscriminately. On September 29, the battle ended with up to 1600 marauders killed in the estate, and Xu Hai's body was found in a nearby stream. On October 10, Chen Dong, Ye Ma, and Xu Hai's hostage brother were all executed in Jiaxing, marking the end of the wokou invasion of 1556.\",\"question\":\"How many days did the battle between Chen Dong and Xu Hai last?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}