{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d9c79c8-fe99-51b1-8612-3d5b1624828b","task_key":"default--validation--ad423f6a~2d2bd8~2d49db~2d9b5f~2da0c365c5622a","task_revision_id":"1","upstream_id":"ad423f6a-2bd8-49db-9b5f-a0c365c5622a","short_description":"Were more American troops killed or taken prisoner?","config":"default","split":"validation","body":"{\"passage\":\"More than 5,000 US troops of General John J. Pershing's forces, including elements of the 7th Cavalry and the African-American U.S. 10th Cavalry Regiment, entered Mexico in hot pursuit of Villa. The campaign consisted primarily of dozens of minor skirmishes with small bands of insurgents. Gen. Pershing failed to catch up to Villa. On 21 June 1916, two troops of the 10th, totaling 92 troopers, attacked Mexican Federal Army troops in an engagement in the Battle of Carrizal, Chihuahua. 12 US troops were killed and 23 taken prisoner; 45 Federales were casualties, including the Mexican general Gomez. The engagement nearly precipitated open war with the Mexican government , but both governments immediately moved to lessen tensions and open negotiations for US withdrawal, preventing war. The prisoners were repatriated at El Paso, Texas by the Carrancista government.\",\"question\":\"Were more American troops killed or taken prisoner?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}