{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f7b2859-f40a-585f-bd3e-b360a03c6631","task_key":"default--validation--ad243a7e~2d0f0f~2d40af~2da1a7~2da46265528668","task_revision_id":"1","upstream_id":"ad243a7e-0f0f-40af-a1a7-a46265528668","short_description":"Which group has a longer life expectancy, males or females?","config":"default","split":"validation","body":"{\"passage\":\"Tunis, the capital, has a population of about 700,000, and the second city of Sfax approximately 250,000. The population growth rate measured as births per female has fallen from 7 (1960s) to 2 (2007). Life expectancy is female 75, male 72. The religion is Islam (98%), with 1% Christian, and 1% Jewish and other. Required education is eight years. The official language is Arabic language, with French language also spoken particularly in commercial dealings, and with less than 2% Berber languages. Literacy by definition includes all over 15 years, and is overall 74%, male 83% and female 65%. In 2006, 7.3 million mobile phones were in use and 1.3 million were on the internet; there were 26 television stations and 29 radio stations.  Over half the population is considered urban, with agricultural workers being about 30% of the total. Unemployment in 2000 was about 15.6%, and in 2006 about 13.9%. Over 300,000 Tunisians were reported to be residing in France during 1994. Left out of the recent prosperity were many rural and urban poor, including small businesses facing the world market.\",\"question\":\"Which group has a longer life expectancy, males or females?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}