{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"844d9d87-1e3e-5577-92eb-918fb4ad9347","task_key":"default--validation--f01c18bd~2d6ba4~2d4d5a~2db35c~2dd444502d96f6","task_revision_id":"1","upstream_id":"f01c18bd-6ba4-4d5a-b35c-d444502d96f6","short_description":"How many more people lived in Albany county in 1731 compared to 1723?","config":"default","split":"validation","body":"{\"passage\":\"In a census of 1697, there were 1,452 individuals living in Albany County; two years later it would be counted as 2,016 at the beginning of King Williams War. By the end of the war in 1698, the population had dropped to 1,482, but rebounded quickly and was at 2,273 by 1703. By 1723, it had increased to 6,501 and in 1731 to 8,573, which was slightly less than the population of the city of New York in the same year. In 1737, the inhabitants of Albany County would outnumber those of New York County by 17 people. In 1774, Albany County, with 42,706 people, was the largest county in colonial New York. According to the first Federal Census in 1790, Albany County reached 75,921 inhabitants and was still the states largest county.\",\"question\":\"How many more people lived in Albany county in 1731 compared to 1723?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}