{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b05a2c2-2198-5ef8-acf3-bff92b44b853","task_key":"default--validation--565b76a3~2d62b6~2d41ca~2db933~2dfeae7975f73c","task_revision_id":"1","upstream_id":"565b76a3-62b6-41ca-b933-feae7975f73c","short_description":"How many more riders were there on an average weekday in 2012 than in 1998?","config":"default","split":"validation","body":"{\"passage\":\"Average daily ridership for DART has been in the vicinity of 200,000 riders per day over the last couple decades. In the 1st quarter of 1998, DARTs weekday ridership averaged 211,000 riders per day system-wide.  Ridership has risen and fallen since then; total ridership, including  ridership, has been as high as 248,500 average weekday riders in the 3rd quarter of 2008, and as low as 194,700 average weekday riders in the 1st quarter of 2010.  However, after a year-long study in 2012 that counted passenger counts through both the existing manual method and a new automated counting system, DART concluded it has been underreporting rail ridership by more than 15 percent each year. In the 4th quarter of 2012, DART reported an average weekday ridership of 252,900. In the fourth quarter of 2014, DART reported total ridership had declined to 233,900 weekday riders.\",\"question\":\"How many more riders were there on an average weekday in 2012 than in 1998?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}