{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9e63a78c-58c0-5e03-8cf2-634f6b5d75db","task_key":"default--validation--9c3c4052~2de775~2d4667~2d9537~2d07f7ab6dc016","task_revision_id":"1","upstream_id":"9c3c4052-e775-4667-9537-07f7ab6dc016","short_description":"How many people living in Bolivia with HIV/AIDS in 2009 did not die from it?","config":"default","split":"validation","body":"{\"passage\":\"Healthcare expenditures comprise only 4.9% of the GDP. According to the 2013 World Factbook, Bolivia ranks 161st in life expectancy with an average age of 68.2 years. In 2009, the World Factbook estimated 12,000 people are living in Bolivia with HIV/AIDS (0.2%) and less than 1,000 of that population died from it. In 2003, it was estimated by the World Health Organization (WHO) that 31.9% of the adult population (12-64) were smokers. According to 2008 WHO data, 17.9% of the population is obese. In 2011, there were 3,255 healthcare institutions, of which 1,134 are considered \\\"first class\\\" (medical personnel and registered nurses) by the Bolivian Ministry of Health Management. The hospitals employed an estimated 10,000 medical doctors in 2001.\",\"question\":\"How many people living in Bolivia with HIV/AIDS in 2009 did not die from it?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}