{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fcba2d1b-f398-5dc6-a3d8-35e7aff555c0","task_key":"default--validation--e8aa6bea~2d590a~2d4b04~2d88ff~2d030f29731d37","task_revision_id":"1","upstream_id":"e8aa6bea-590a-4b04-88ff-030f29731d37","short_description":"how many yards did Peyton Manning toss?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their miraculous comeback in San Diego and subsequent bye week, the Broncos returned home for an interconference duel against the New Orleans Saints. The Broncos grabbed the lead in the first quarter, with running back Willis McGahee rushing for a 1-yard touchdown. On the Broncos' next possession, McGahee committed a fumble, and the Saints responded early in the second quarter, with quarterback Drew Brees throwing his 300th career touchdown pass—a 29-yarder to running back Darren Sproles. On the Saints' next possession, Brees was intercepted by linebacker Wesley Woodyard, and the Broncos dominated the remainder of the game. Quarterback Peyton Manning tossed a 13-yard touchdown pass to wide receiver Eric Decker and placekicker Matt Prater nailed a 33-yard field goal to close out the first half. The Broncos increased their lead in the third quarter, with Manning connecting on a 1-yard touchdown pass to wide receiver Demaryius Thomas, then pulled away in the fourth quarter, with a 2-yard touchdown pass from Manning to Decker and another 33-yard field goal by Prater. The Saints scored a late touchdown, with Brees connecting on an 18-yard pass to wide receiver Jimmy Graham, but the game had already been decided in the Broncos' favor. Linebacker Joe Mays suffered a fractured fibula on a kickoff return during the fourth quarter, and was placed on the season-ending injured reserve the following day (October 29). Drew Brees surpassed John Elway for sixth on the NFL's all-time list for touchdown passes. However, Brees' personal record dropped to 0-7 in games played at Denver.\",\"question\":\"how many yards did Peyton Manning toss?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}