{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bb8fd198-6e16-5728-8f21-2d4882c3a701","task_key":"default--validation--6216f799~2d7566~2d49ff~2d93c8~2d53c9a1f7b181","task_revision_id":"1","upstream_id":"6216f799-7566-49ff-93c8-53c9a1f7b181","short_description":"How many percent higher was male unemployment compared to female in 2009?","config":"default","split":"validation","body":"{\"passage\":\"After being higher in the postwar period, the U.S. unemployment rate fell below the rising eurozone unemployment rate in the mid-1980s and has remained significantly lower almost continuously since. In 1955, 55% of Americans worked in services, between 30% and 35% in industry, and between 10% and 15% in Agriculture in the United States. By 1980, over 65% were employed in services, between 25% and 30% in industry, and less than 5% in agriculture. Male unemployment continued to be significantly higher than those of females (at 9.8% vs. 7.5% in 2009). The unemployment among Caucasians continues being much lower than those for African-Americans (at 8.5% vs. 15.8% also in 2009).\",\"question\":\"How many percent higher was male unemployment compared to female in 2009?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}