{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"55c133ca-79b7-5fad-a1e0-cd0fb134c743","task_key":"default--validation--53825b9d~2d5f79~2d4437~2d902c~2dfa49d183f96e","task_revision_id":"1","upstream_id":"53825b9d-5f79-4437-902c-fa49d183f96e","short_description":"How many more per capita for the city of Daphne in retail sales than the…","config":"default","split":"validation","body":"{\"passage\":\"Daphne is a suburb of nearby Mobile, Alabama. In 2007, Daphne saw retail sales of $653,422,000 or $34,438 per capita which compares favorably to the national average of $12,364. The median household income was $62,376 against a national average of $42,934, both measured through the 2007-2011 period. The home ownership was 74.6% and the median home value (2007-2011) was $187,000. The city is part of the Daphne-Fairhope-Foley metropolitan statistical area and was named among the top 10 such areas nationwide by Site Selection Magazine. The ranking is for areas with less than 200,000 population and is based upon the number of companies either expanding or relocating to the area.\",\"question\":\"How many more per capita for the city of Daphne in retail sales than the national average?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}