{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"94e8c328-1115-5dab-a3ce-1bc67ea1a495","task_key":"default--validation--b1db4fbc~2d5656~2d4489~2db99a~2d867f0d98f86e","task_revision_id":"1","upstream_id":"b1db4fbc-5656-4489-b99a-867f0d98f86e","short_description":"Doctor Archibald Cameron was executed how many years after Balmerio was?","config":"default","split":"validation","body":"{\"passage\":\"After Culloden, government forces spent the next few weeks searching for rebels, confiscating cattle and burning Non-Juring Episcopalian and Catholic meeting houses; many of those who participated in the Rebellion came from this element of Scottish society. Prisoners from regiments in the French service were treated as POWs and exchanged, but 3,500 captured Jacobites were indicted for treason. 650 of these died awaiting trial, 120 were executed , 900 were pardoned and the rest transported. The Jacobite lords Kilmarnock, Balmerino and Lovat were beheaded on Tower Hill in April 1747, but these were among the last executions. Public sympathies had shifted and Cumberland's insistence on severity earned him the nickname 'Butcher' from a City of London alderman. The last Jacobite to be executed was Doctor Archibald Cameron, younger brother of Lochiel. Convicted of treason for his part in the 45, he escaped into exile; when he returned to Scotland in March 1753, he was allegedly betrayed by members of his own clan and executed in London on 7 June.\",\"question\":\"Doctor Archibald Cameron was executed how many years after Balmerio was?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}