{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"001c2e11-b4e8-5537-b109-7e898c0e0033","task_key":"default--validation--9794f852~2ddd26~2d404f~2d94f4~2d40712929bdd8","task_revision_id":"1","upstream_id":"9794f852-dd26-404f-94f4-40712929bdd8","short_description":"How many more scribes than scholars were in the editorial board created in march…","config":"default","split":"validation","body":"{\"passage\":\"Late in the 18th Century, Qing dynasty set about a momentous task, the creation of the Siku Quanshu. The Qianlong Emperor ordered the creation of the Siku Quanshu in 1772. Local and Provincial officers were in charge of locating and collecting important books. The Qianlong Emperor encouraged owners of rare or valuable books to send them to the capital, however few actually did due to concerns about the Literary Inquisition. Towards the end of 1772, seeing that only a limited number of people actually handed in books, the Qianlong Emperor issued imperial decrees stressing that books would be returned to their owners once the compilation was finished and that owners of the books would not be persecuted if their books contained anti-Manchu sentiment. Less than three months after the issue of this decree, four to five thousand books were handed in. By March of 1773, an editorial board  was created in Beijing to gather and review books brought to them. This board included over 361 scholars, with Ji Yun and Lu Xixiong  as chief editors. There was around 3,826 scribes who copied every word by hand. These copyists were not paid in coinage but in government positions after they had transcribed a set amount of the encyclopedia. It took over a decade until the encyclopedia was completed and all seven copies were distributed.\",\"question\":\"How many more scribes than scholars were in the editorial board created in march of 1773?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}