{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b67d9cb0-0254-51d8-a464-180bd5d68e1e","task_key":"default--validation--d1cbdc0f~2db17e~2d4842~2d855b~2dd459d0836f8b","task_revision_id":"1","upstream_id":"d1cbdc0f-b17e-4842-855b-d459d0836f8b","short_description":"Who had more forces, the Spanish or the Rifians?","config":"default","split":"validation","body":"{\"passage\":\"In May 1924, the French Army had established a line of out-posts north of the Oureghla River in disputed tribal territory. On 12 April 1925, an estimated 8,000 Rifians attacked this line and in two weeks over 40 of 66 French posts had been stormed or abandoned. French casualties exceeded 1,000 killed, 3,700 wounded and 1,000 missing - representing losses of over 20 percent of their forces deployed in the Rif. The French accordingly intervened on the side of Spain, employing up to 160,000 well trained and equipped troops from Metropolitan, Algerian, Senegalese and Foreign Legion units, as well as Moroccan regulars  and auxiliaries . With total Spanish forces now numbering about 90,000 the Rifian forces were now seriously outnumbered by their Franco-Spanish opponents. Final French deaths from battle and disease, in what had now become a major war, were to total 8,628.\",\"question\":\"Who had more forces, the Spanish or the Rifians?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}