{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97a5de8a-258b-57b0-a854-ad00193d0828","task_key":"default--validation--02855ce0~2d70d9~2d4dc1~2da84d~2d729d7fb8ad6a","task_revision_id":"1","upstream_id":"02855ce0-70d9-4dc1-a84d-729d7fb8ad6a","short_description":"Was life expectancy longer in 2015 or 1989?","config":"default","split":"validation","body":"{\"passage\":\"Like most other European countries, Hungary is experiencing sub-replacement fertility; its estimated total fertility rate of 1.43 is well below the replacement rate of 2.1, albeit higher than its nadir of 1.28 in 1999. As a result, its population has gradually declining and rapidly aging. In 2011, the conservative government began a program to increase the birth rate with a focus on ethnic Magyars by reinstating 3 year maternity leave as well as boosting part-time jobs. The birth rate has gradually increased from 1.27 children born/woman in 2011. The natural decrease in the first 10 months of 2016 was only 25,828 which was 8,162 less than the corresponding period in 2015. In 2015, 47.9% of births were to unmarried women. Life expectancy was 71.96 years for men and 79.62 years for women in 2015, growing continuously since the End of Communism in Hungary (1989).\",\"question\":\"Was life expectancy longer in 2015 or 1989?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}