{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8144d747-ad3d-54a1-8bb7-001169af9f2c","task_key":"default--validation--c44c5ebf~2daa04~2d4917~2d9cf8~2d99c13a1234f9","task_revision_id":"1","upstream_id":"c44c5ebf-aa04-4917-9cf8-99c13a1234f9","short_description":"how many yards did lewis get","config":"default","split":"validation","body":"{\"passage\":\" at Raymond James Stadium, Tampa, Florida TV Time: CBS 1:00pm eastern The Ravens opened the regular season on the road against the Tampa Bay Buccaneers on September 10. In QB Steve McNair's inaugural start as a Raven, the team gave a dominating performance. RB Jamal Lewis got the team's first points as he ran into the endzone on a four-yard touchdown strike in the first quarter. Then, in the second quarter, CB Chris McAlister intercepted a pass from Tampa Bay QB Chris Simms and ran 60 yards for another touchdown. Rookie Haloti Ngata recorded his first career interception and also returned for 60 yards to set up kicker Matt Stover with a 20-yard field goal to put the Ravens up 17-0 at halftime. Baltimore continued to suppress Tampa Bay in the second half, as Stover kicked a 42-yard field goal in the third quarter to put Baltimore up 20-0. In the fourth quarter, McNair put the game away with a 4-yard pass to TE Daniel Wilcox. While the Ravens offense had a very good start to the 2006 season, the defense also showed much promise, as they forced Simms into throwing three interceptions and limited star RB Carnell \\\"Cadillac\\\" Williams to just 22 yards on eight carries. For his efforts in this game Ray Lewis was named NFL Defensive Player of the Week after recording 10 tackles and a sack. With the win, the Ravens were 1-0 and 1-0 against NFC Opponents.\",\"question\":\"how many yards did lewis get\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}