{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0ec4739-b8dc-5401-8477-ab1372b2df1f","task_key":"default--validation--e15555fe~2d0a2b~2d4d0c~2d833e~2d886a1b5fa359","task_revision_id":"1","upstream_id":"e15555fe-0a2b-4d0c-833e-886a1b5fa359","short_description":"Was the Pennsyvlania state birth rate lower in 2000 or in 2011?","config":"default","split":"validation","body":"{\"passage\":\"Carbon Countys live birth rate was 646 births in 1990. Carbon County live birth rate in 2000 declined to 566 births, while in 2011 it rose to 586 babies. Over the past 50 years (1960 to 2010), rural Pennsylvania saw a steady decline in both the number and proportion of residents under 18 years old. In 1960, 1.06 million rural residents, or 35 percent of the rural population, were children. According to data from the Pennsylvania Department of Health, in 1990, the Commonwealth of Pennsylvanias birth rate was 171,053. In 2000, Pennsylvanias birth rate was 145,874. Finally in 2011, the States birth rate declined further to 142,021. From 2000 to 2009, the number of babies born in rural counties declined 5 percent. Urban counties have also experienced a decline in the number of school aged children. From 2000-2010 urban Pennsylvania counties had a 3 percent decline in the number of residents under 18 years old. In 2010, there were 2.07 million residents, or 22 percent of the urban population, who were under age 18.\",\"question\":\"Was the Pennsyvlania state birth rate lower in 2000 or in 2011?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}