{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"81524c82-2a5b-53cb-80a6-5aa1bec3c272","task_key":"default--validation--e36cca76~2dc300~2d45e3~2da85e~2d4901adfdbfb5","task_revision_id":"1","upstream_id":"e36cca76-c300-45e3-a85e-4901adfdbfb5","short_description":"How many percent of Paraguay's working population does not work in the services…","config":"default","split":"validation","body":"{\"passage\":\"The services sector made up nearly 50 percent of Paraguay's gross domestic product in 2004 and employed about 19 percent of Paraguay's working population. The importation of goods, especially from Argentina and Brazil, for sale and illegal reexportation creates service industry jobs. The services sector had a moderate growth rate of 0.9 percent from 1990 to 2003. The sector decreased by 7.8 percent in 2002, before rebounding in 2003 with a 1.6 percent growth rate. Instability in the economy and a large black market have hampered development of the formal services sector in Paraguay.\",\"question\":\"How many percent of Paraguay's working population does not work in the services sector?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}