{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7ac0378-d65b-5fa9-8c75-85bfacf06663","task_key":"default--validation--ea36c225~2dc16b~2d45ef~2da47a~2df0722e3f4f67","task_revision_id":"1","upstream_id":"ea36c225-c16b-45ef-a47a-f0722e3f4f67","short_description":"How many points higher was the HDI value of Xochimilco than Iztapalapa?","config":"default","split":"validation","body":"{\"passage\":\"In contrast, the boroughs of Xochimilco (172nd), Tláhuac (177th), and Iztapalapa (183rd) presented the lowest HDI values of the Federal District with values of 0.8481, 0.8473, and 0.8464 respectively, which are still in the global high-HDI range. The only borough that did not have a high HDI was that of rural Milpa Alta, which had a \\\"medium\\\" HDI of 0.7984, far below all of the other boroughs (627th nationally, the rest being in the top 200). Mexico Citys HDI for the 2005 report was of 0.9012 (very high), and its 2010 value of 0.9225 (very high), or (by newer methodology) 0.8307, was Mexicos highest.\",\"question\":\"How many points higher was the HDI value of Xochimilco than Iztapalapa?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}