{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd837a8a-6588-5111-b3a4-83ed2c60fda4","task_key":"default--validation--769d537c~2d069f~2d44bb~2daabd~2d49beb63b202d","task_revision_id":"1","upstream_id":"769d537c-069f-44bb-aabd-49beb63b202d","short_description":"By how many dollars did the average individual income in Ontario raise between…","config":"default","split":"validation","body":"{\"passage\":\"Census tract 0038.00 of the 2006 Canadian census covers Kensington Market. In the time between these censuses, the population of Kensington Market grew by 1.08% from being 3,740 in 2006 to rising to 4,029 in 2011 (Census 2006, Census 2011). The 2006 Canadian census revealed that the average family income in Kensington was $61,339, compared to the City of Toronto which has an average family income of $96,602.00. The 2006 Canadian census also revealed that the average income for individuals was $23, 335, whereas in 2011 with a GNR% of 29.4%, the average individual income was $26, 403. This is relatively low in comparison to the average individual income calculated for Ontario, being $38,099 in 2006, and in 2011 with a GNR% of 27.1% the Ontarian average income was $42,264 (Census 2006, Census 2011). In addition, 71.6% of the population of this census tract earned under $50,000 (Census 2006) in 2006. This is comparable to the 78.2% of the population that earned under $50,000 (Census 2011) in the following census year i.e. 2011. It is noteworthy that a shocking 22.8% of the census tract population earned under $10,000 in 2006 (Census 2006) which increased to 27.4% in 2011 (Census 2011).\",\"question\":\"By how many dollars did the average individual income in Ontario raise between 2006 and 2011?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}