{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b8175eb7-3b7c-5240-b51e-8d19a59b06cd","task_key":"default--validation--d9144b3d~2dfaaf~2d49dd~2d8189~2d5cc3ffeb19fa","task_revision_id":"1","upstream_id":"d9144b3d-faaf-49dd-8189-5cc3ffeb19fa","short_description":"Where did the Spanish defeat happen second, Melilla or Lobo Canyon?","config":"default","split":"validation","body":"{\"passage\":\"As a result of these deaths, Prime Minister Antonio Maura increased the Spanish garrison at Melilla from 5,000 men to 22,000 in preparation for an offensive. All the Spanish forces involved were conscripts; at this stage, Spain had neither professional troops, nor indigenous troops under arms. The Spanish army was poorly trained and equipped and lacked basic maps. The next day, the Spanish troops were shot at by francs-tireurs and skirmishes occurred near Melilla. General Marina decided to post six companies at Ait Aixa, under command of Colonel Álvarez Cabrera. They left Melilla at nightfall but got lost and, in the morning, found themselves in the Alfer Canyon, where they were decimated by gunfire from the heights. Colonel Cabrera and 26 men were killed, and 230 were wounded. On 26 June, the Spanish suffered a second defeat at the Lobo Canyon, when Marina sent another force under General Pintos to protect Segunda Caseta. In this ambush, the Rifians killed General Pintos and 153 men, and wounded some 600 others.\",\"question\":\"Where did the Spanish defeat happen second, Melilla or Lobo Canyon?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}