{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c46fcdc8-7281-5cb1-987f-cdb7b3624b7b","task_key":"default--validation--ee406a3a~2dab8c~2d4e85~2d8a36~2dbb58338971ba","task_revision_id":"1","upstream_id":"ee406a3a-ab8c-4e85-8a36-bb58338971ba","short_description":"How many of Paraguay's working population was not employed by the services…","config":"default","split":"validation","body":"{\"passage\":\"The services sector made up nearly 50 percent of Paraguay's gross domestic product in 2004 and employed about 19 percent of Paraguay's working population. The importation of goods, especially from Argentina and Brazil, for sale and illegal reexportation creates service industry jobs. The services sector had a moderate growth rate of 0.9 percent from 1990 to 2003. The sector decreased by 7.8 percent in 2002, before rebounding in 2003 with a 1.6 percent growth rate. Instability in the economy and a large black market have hampered development of the formal services sector in Paraguay.\",\"question\":\"How many of Paraguay's working population was not employed by the services sector in 2004, by percent?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}