{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9bbeaa42-54c1-5bbd-aa7c-9b6a16b585d7","task_key":"default--validation--931c2155~2db195~2d4819~2d9194~2d69387a2ddb04","task_revision_id":"1","upstream_id":"931c2155-b195-4819-9194-69387a2ddb04","short_description":"By how many dollars did the average individual income raise between 2006 and…","config":"default","split":"validation","body":"{\"passage\":\"Census tract 0038.00 of the 2006 Canadian census covers Kensington Market. In the time between these censuses, the population of Kensington Market grew by 1.08% from being 3,740 in 2006 to rising to 4,029 in 2011 (Census 2006, Census 2011). The 2006 Canadian census revealed that the average family income in Kensington was $61,339, compared to the City of Toronto which has an average family income of $96,602.00. The 2006 Canadian census also revealed that the average income for individuals was $23, 335, whereas in 2011 with a GNR% of 29.4%, the average individual income was $26, 403. This is relatively low in comparison to the average individual income calculated for Ontario, being $38,099 in 2006, and in 2011 with a GNR% of 27.1% the Ontarian average income was $42,264 (Census 2006, Census 2011). In addition, 71.6% of the population of this census tract earned under $50,000 (Census 2006) in 2006. This is comparable to the 78.2% of the population that earned under $50,000 (Census 2011) in the following census year i.e. 2011. It is noteworthy that a shocking 22.8% of the census tract population earned under $10,000 in 2006 (Census 2006) which increased to 27.4% in 2011 (Census 2011).\",\"question\":\"By how many dollars did the average individual income raise between 2006 and 2011?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}