{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a072e57-3fe9-571c-9bd5-067d7dce7dbd","task_key":"default--validation--8016314b~2dbc6a~2d46b9~2da53a~2dc1b048569df9","task_revision_id":"1","upstream_id":"8016314b-bc6a-46b9-a53a-c1b048569df9","short_description":"how many yards did prater nail?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their overtime win at San Diego, the Broncos traveled to the Mall of America Field at the Hubert H. Humphrey Metrodome for an interconference duel with the Minnesota Vikings. The game's first points came from the Vikings, when defensive end Jared Allen tackled running back Willis McGahee in the end zone for a safety. The Broncos grabbed the lead when linebacker Mario Haggan returned an interception off Vikings' quarterback Christian Ponder 16 yards for a touchdown. Vikings' kicker Ryan Longwell made a 40-yard field goal, then the Vikings reclaimed the lead in the second quarter, on a 19-yard touchdown pass from Ponder to tight end Kyle Rudolph, followed by another field goal by Longwell, this time from 25 yards, just before halftime. The Broncos narrowed Minnesota's lead in the third quarter, with a 21-yard touchdown pass from quarterback Tim Tebow to wide receiver Demaryius Thomas, but the Vikings countered with a 52-yard touchdown pass from Ponder to wide receiver Percy Harvin. The Broncos responded with a 41-yard touchdown pass from Tebow to Thomas. Ponder then threw a 48-yard touchdown pass to Harvin to give Minnesota a 29-21 lead. On the Broncos' next possession, McGahee rushed 24 yards for a touchdown and Tebow scrambled for a two-point conversion to tie the game at 29. The Vikings subsequently reclaimed the lead on Longwell's 39-yard field goal with 3:06 left in the game. The Broncos answered with kicker Matt Prater's 46-yard field goal with 1:33 left to tie the game at 32. On the Vikings' ensuing possession, Broncos' cornerback André Goodman returned an interception off Ponder to the Vikings' 15-yard line. Six plays later, Prater nailed the game-winning 23-yard field goal as time expired to give the Broncos their fifth consecutive win.\",\"question\":\"how many yards did prater nail?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}