{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2341eb5d-f886-5567-b1ae-18678fae38a5","task_key":"default--validation--459ec315~2d291d~2d4530~2d8e31~2d717998430478","task_revision_id":"1","upstream_id":"459ec315-291d-4530-8e31-717998430478","short_description":"How many years past since Khitans first invaded Korea to when they built a…","config":"default","split":"validation","body":"{\"passage\":\"In 993, Khitans under General Xiao Sunning invaded Korea, but retreated after truce negotiations with minister Seo Hui of Goryeo, establishing friendly relations between the two nations. In 1004, the Liao dynasty repulsed Song China. Subsequently, as part of peace negotiations, Song China to paid tribute to the Liao emperor. However, the tension between Goryeo and Liao created another war. In 1009, General Gang Jo of Goryeo led a coup against King Mokjong, killing the king and establishing military rule. In 1010, the alliance was broken and Liao attacked Korea for General Gang's treason. Also, Khitans claimed six garrison settlements east of the Yalu River, which Goryeo claimed as its territory in truce negotiations during 993. After suffering numerous and heavy casualties against the Goryeo army, the Khitans managed to defeat Gangjo, who had begun to underestimate them. Despite this defeat, the Goryeo king managed to retain his claim on the six garrison settlements. The Khitans retreated from the peninsula, with no great prize for the war, but they did not give up their hope of gaining the six garrison settlements and making Goryeo pay tribute. However, beginning in the summer of 1018, the Khitans constructed a bridge across the Yalu River.\",\"question\":\"How many years past since Khitans first invaded Korea to when they built a bridge over the Yalu River?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}