{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8f977aed-756e-5801-a327-92b35d03eaeb","task_key":"default--validation--ea519b80~2dd1b7~2d44c0~2d822f~2d7a7aeb493d96","task_revision_id":"1","upstream_id":"ea519b80-d1b7-44c0-822f-7a7aeb493d96","short_description":"How many more deaths in urban areas than rural areas?","config":"default","split":"validation","body":"{\"passage\":\"Although as of 2007 the population was declining, the decline was stabilizing and was more pronounced in urban areas. Out of the 19,667 births reported in 2007, 12,631 were in urban areas (11.86 per 1000) and 7,036 were in rural areas (14.88 per 1000). Birth rates for rural areas are 25% higher than that of urban areas. Of the total of 21,727 deaths, 14,366 were reported in urban areas (13.49 per 1000) and 7,361 were in rural areas (15.56 per 1000). Natural decline of population was measured at -0.16% for urban areas and an insignificant -0.07% for rural areas (average for Russia was -0.33% in 2007).\",\"question\":\"How many more deaths in urban areas than rural areas?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}