{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"766cc802-ceae-5e15-b10f-4fb2ff87217f","task_key":"default--validation--6fb31074~2dec7a~2d47b7~2d8d66~2ddf4134384f2f","task_revision_id":"1","upstream_id":"6fb31074-ec7a-47b7-8d66-df4134384f2f","short_description":"How many more people were employed in 1997 than in 2008?","config":"default","split":"validation","body":"{\"passage\":\"Under a much broader definition (including people that have given up searching for employment) two different studies determined the unemployment rate to be 36.7% (2004) and 51.2% (2008), respectively. This estimate considers people in the Informal sector as employed. 72% of jobless people have been unemployed for two years or more. Labour and Social Welfare Minister Immanuel Ngatjizeko praised the 2008 study as \\\"by far superior in scope and quality to any that has been available previously\\\", but its methodology has also received criticism. The total number of formally employed people stood at 400,000 in 1997 and fell 330,000 in 2008, according to a government survey. The NSA 2012 study counted 396,000 formal employees. Of annually 25,000 school leavers only 8,000 gain formal employment-largely a result of a failed Education in Namibia.\",\"question\":\"How many more people were employed in 1997 than in 2008?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}