{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c2595b70-13c9-5361-af85-c6bb168e9008","task_key":"default--validation--729cba0a~2dfdee~2d4af3~2d902f~2d23d32937d503","task_revision_id":"1","upstream_id":"729cba0a-fdee-4af3-902f-23d32937d503","short_description":"Who did Derry close the gates against on December 7th, 1688?","config":"default","split":"validation","body":"{\"passage\":\"After William's landing in England, James' Lord Deputy in Ireland, Richard Talbot, 1st Earl of Tyrconnell took action to ensure that all strong points in Ireland were held by garrisons of the newly recruited Irish Catholic army, loyal to James. The northern province of Ulster, which had the heaviest concentration of English and Scottish settlers, was the only part of Ireland where Talbot encountered significant resistance. An attempted rising by the Protestant inhabitants of Bandon in County Cork was quickly defeated by Jacobite forces. By November 1688, only the walled city of Derry had a Protestant garrison. A Jacobite army of around 1,200 men, mostly \\\"Redshanks\\\" , under Alexander MacDonnell, 3rd Earl of Antrim, was slowly organised . When they arrived on 7 December 1688 the gates were closed against them and the Siege of Derry began. While the Jacobites appeared to have great advantages in terms of numbers in Ireland, in fact, the troops raised by Tyrconnell were mainly hastily conscripted peasant bands, most of them poorly armed and trained. Nevertheless, a Jacobite force under Richard Hamilton routed a Protestant Williamite militia in an encounter at Dromore, County Down  on 14 March 1689 and occupied eastern Ulster.\",\"question\":\"Who did Derry close the gates against on December 7th, 1688?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}