{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4d28f89-39fc-594c-af3c-14c1c681dcc7","task_key":"default--validation--663b5eca~2d7023~2d43dc~2d966d~2d7231abc252a9","task_revision_id":"1","upstream_id":"663b5eca-7023-43dc-966d-7231abc252a9","short_description":"How many years was Baldwin de Burg nephew of Baldwin I of Jerusalem and Count of…","config":"default","split":"validation","body":"{\"passage\":\"Baldwin de Burg was a nephew of Baldwin I of Jerusalem and the Count of Edessa from 1100 to 1118. In 1118 his uncle died and he became King Baldwin II of Jerusalem. In the Battle of Ager Sanguinis, fought near Sarmada on 28 June 1119, the Franks suffered a disastrous defeat by the forces of Ilghazi, the ruler of Mardin. Later that year Baldwin regained some territory, but the Franks were seriously weakened. Baldwin asked for help from Pope Callixtus II. The pope forwarded the request to Venice. The terms of the crusade were agreed through negotiations between the envoys of Baldwin II and the doge of Venice. Once the Venetians decided to participate, Pope Callixtus II sent them his papal banner to signify his approval, At the First Council of the Lateran he confirmed that the Venetions had crusader privileges, including remission of their sins. The church also extended its protection to the families and property of the crusaders. In 1122 the Doge of Venice, Domenico Michiel, launched the seaborne crusade. The Venetian fleet of more than 120 ships carrying over 15,000 men left the Venetian Lagoon on 8 August 1122. This seems to have been the first crusade in which the knights brought their horses with them. They invested Corfu, then a possession of the Byzantine Empire, with which Venice had a dispute over privileges. In 1123 Baldwin II was captured by Balak of Mardin, emir of Aleppo, and imprisoned in Kharput. Eustace Graverius became regent of Jerusalem. The Venetians abandoned the siege of Corfu when they heard this news, and reached the Palestinian coast in May 1123.\",\"question\":\"How many years was Baldwin de Burg nephew of Baldwin I of Jerusalem and Count of Edessa?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}