{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fe00751a-f089-55f2-a556-ba9dc7d175db","task_key":"default--validation--9b4031f5~2d0ecc~2d485a~2d96c1~2d9376a7472c9a","task_revision_id":"1","upstream_id":"9b4031f5-0ecc-485a-96c1-9376a7472c9a","short_description":"What happened first: obtained passports for MacGill's sons or MacGill died?","config":"default","split":"validation","body":"{\"passage\":\"In 1570 MacGill reluctantly accepted appointment as Provost of Edinburgh. In November 1571, during the War between Leith and Edinburgh when Mary's supporters held Edinburgh Castle, MacGill was sent with Robert Pitcairn, Commander of Dunfermline to negotiate with Henry, Lord Hunsdon at Berwick upon Tweed. MacGill was to ask for 8 cannons, 3000 footmen and pikemen, and support for 1000 Scots troops, in the cause of the \\\"maintenance and protection of the true religion to the confusion of those that now goes about to disturb the same\\\". MacGill had a particular interest in the siege as the \\\"registers and records of the chief matters\\\" were guarded by artillery at Edinburgh Castle, together with the Scottish Crown jewels. The forces holding Edinburgh Castle, known as the Castilians, in 1572 twice destroyed MacGill's stronghouses in Edinburgh, and while the siege lasted the Burgh Council met in exile at Leith. Regent Morton wrote to MacGill in 1575 asking him to re-negotiate a gold and silver mining contract with the Dutch engineer Cornelius de Vos. A portrait painter working in Scotland at this time, Arnold Bronckorst, was associated with Cornelius and Nicholas Hilliard. Morton also obtained passports for MacGill's sons, John and David, to travel to France to continue their studies. MacGill died on 16 October 1579. Alexander Hay succeeded him as Lord Clerk Register. His executors were his wife Janet Adamsoun and son, Master James Adamson.\",\"question\":\"What happened first: obtained passports for MacGill's sons or MacGill died?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}