{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a9207782-5e55-5813-90b3-e068b33e00fd","task_key":"default--validation--06297983~2d7c67~2d44fd~2d87d6~2d36d89b2bbc22","task_revision_id":"1","upstream_id":"06297983-7c67-44fd-87d6-36d89b2bbc22","short_description":"Was the national average life expectancy lower in 1985 or in 2013?","config":"default","split":"validation","body":"{\"passage\":\"Of 3,142 counties in the United States in 2013, McDowell County ranked 3,142 in the life expectancy of both male and female residents.  Males in McDowell County lived an average of 63.5 years and females lived an average of 71.5 years compared to the national average for life expectancy of 76.5 for males and 81.2 for females. Moreover, the average life expectancy in McDowell County declined by 3.2 years for males and 4.1 years for females between 1985 and 2013 compared to a national average for the same period of an increased life span of 5.5 years for men and 3.1 years for women. High rates of smoking and obesity and a low level of physical activity appear to be contributing factors to the declining life expectancy for both sexes.\",\"question\":\"Was the national average life expectancy lower in 1985 or in 2013?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}