{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd1f4f3a-7e8e-52ee-829e-b036987ee433","task_key":"default--validation--4092beae~2db357~2d42c9~2da821~2d9d7d3cce5ad7","task_revision_id":"1","upstream_id":"4092beae-b357-42c9-a821-9d7d3cce5ad7","short_description":"How many years between his active military service retirement was it before he…","config":"default","split":"validation","body":"{\"passage\":\"Lévis returned to France on parole, and was released for service in Europe by William Pitt. He served in the German campaigns of 1762, and retired from active military service when the war ended in 1763 with the Peace of Paris. He was appointed governor of Artois in 1765. He was promoted to Marshal of France in 1783, and was raised to the inheritable title Duc de Lévis in 1784. He died in 1787 in Arras, France, and was succeeded as duke of Lévis by his son Pierre-Marc-Gaston, who escaped to England during the French Revolution. His widow and three daughters were sent to the guillotine during the French Revolution. He left his name to Lévis, Quebec, across the river from Quebec City.\",\"question\":\"How many years between his active military service retirement was it before he was appointed governor of Artois?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}