{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a3d5df29-b015-5370-8914-b3ef0e1e419d","task_key":"default--validation--d75904fe~2dc14c~2d4154~2daece~2dae86e6529c73","task_revision_id":"1","upstream_id":"d75904fe-c14c-4154-aece-ae86e6529c73","short_description":"What year did the service sector have a higher growth rate, 2002 or 2003?","config":"default","split":"validation","body":"{\"passage\":\"The services sector made up nearly 50 percent of Paraguay's gross domestic product in 2004 and employed about 19 percent of Paraguay's working population. The importation of goods, especially from Argentina and Brazil, for sale and illegal reexportation creates service industry jobs. The services sector had a moderate growth rate of 0.9 percent from 1990 to 2003. The sector decreased by 7.8 percent in 2002, before rebounding in 2003 with a 1.6 percent growth rate. Instability in the economy and a large black market have hampered development of the formal services sector in Paraguay.\",\"question\":\"What year did the service sector have a higher growth rate, 2002 or 2003?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}