{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a4e66d10-cc29-5674-858f-78b1b9719873","task_key":"default--validation--bf4502cc~2dea26~2d4a01~2da942~2d94c5c0353afb","task_revision_id":"1","upstream_id":"bf4502cc-ea26-4a01-a942-94c5c0353afb","short_description":"Which were there more of in Bolivia, higher obese population of obese or higher…","config":"default","split":"validation","body":"{\"passage\":\"Healthcare expenditures comprise only 4.9% of the GDP. According to the 2013 World Factbook, Bolivia ranks 161st in life expectancy with an average age of 68.2 years. In 2009, the World Factbook estimated 12,000 people are living in Bolivia with HIV/AIDS (0.2%) and less than 1,000 of that population died from it. In 2003, it was estimated by the World Health Organization (WHO) that 31.9% of the adult population (12-64) were smokers. According to 2008 WHO data, 17.9% of the population is obese. In 2011, there were 3,255 healthcare institutions, of which 1,134 are considered \\\"first class\\\" (medical personnel and registered nurses) by the Bolivian Ministry of Health Management. The hospitals employed an estimated 10,000 medical doctors in 2001.\",\"question\":\"Which were there more of in Bolivia, higher obese population of obese or higher adult population of smokers in 2008?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}