{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"90bbf38b-a458-5ba5-99e2-8d8df89ddbe0","task_key":"default--validation--39ed2154~2d959c~2d43fc~2dba6b~2d46fc31f01dfc","task_revision_id":"1","upstream_id":"39ed2154-959c-43fc-ba6b-46fc31f01dfc","short_description":"How many years into the moderate growth did they see a decline before going back…","config":"default","split":"validation","body":"{\"passage\":\"The services sector made up nearly 50 percent of Paraguay's gross domestic product in 2004 and employed about 19 percent of Paraguay's working population. The importation of goods, especially from Argentina and Brazil, for sale and illegal reexportation creates service industry jobs. The services sector had a moderate growth rate of 0.9 percent from 1990 to 2003. The sector decreased by 7.8 percent in 2002, before rebounding in 2003 with a 1.6 percent growth rate. Instability in the economy and a large black market have hampered development of the formal services sector in Paraguay.\",\"question\":\"How many years into the moderate growth did they see a decline before going back up a year later?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}