{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8a5bb6f2-ce55-54db-9fc5-0116e6033c54","task_key":"default--validation--e1668e02~2d998b~2d4a36~2dbd31~2d41ace887db5b","task_revision_id":"1","upstream_id":"e1668e02-998b-4a36-bd31-41ace887db5b","short_description":"How many teams had 15 regular season wins between 1984 and 2000?","config":"default","split":"validation","body":"{\"passage\":\"In 1984, the 49ers had one of the greatest seasons in team history by finishing the regular season 15-1-0, setting the record for most regular season wins that was later equaled by the 1985 Chicago Bears, the 1998 Minnesota Vikings, the 2004 Pittsburgh Steelers, the 2011 Green Bay Packers and finally broken by the 2007 New England Patriots (with 16 regular season victories). Their 18 wins overall is also still a record, tied by the 1985 Bears and the 2007 New England Patriots (they won 18 straight, but lost Super Bowl XLII to the New York Giants). The 49ers only defeat in the 1984 season was a 20-17 loss to the Steelers; a late field goal attempt in that game by San Francisco kicker Ray Wersching went off the uprights and was no good. In the playoffs, they beat the New York Giants 21-10, shut out the Chicago Bears 23-0 in the NFC championship, and in Super Bowl XIX the 49ers shut down a record-setting year by NFL MVP Dan Marino (and his speedy receivers Mark Clayton and Mark Duper), beating the Miami Dolphins 38-16. Their entire defensive backfield (Ronnie Lott, Eric Wright, Dwight Hicks, and Carlton Williamson) was elected to the Pro Bowl—an NFL first.\",\"question\":\"How many teams had 15 regular season wins between 1984 and 2000?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}