{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb70223e-3fa2-5afa-b9d7-a81fdc26db49","task_key":"default--validation--a9772fed~2da6dc~2d4f65~2db128~2d79d7cc582d5e","task_revision_id":"1","upstream_id":"a9772fed-a6dc-4f65-b128-79d7cc582d5e","short_description":"How many touchdowns did the Broncos score in the first half?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their win over the Jaguars, the Broncos traveled to Lucas Oil Stadium for an AFC duel with the Indianapolis Colts. The Broncos grabbed the early lead in the first quarter, with quarterback Peyton Manning connecting with wide receiver Eric Decker on a 17-yard touchdown pass. The Colts responded, with a 27-yard field goal by placekicker Adam Vinatieri. Following a fumble by Broncos' return specialist Trindon Holliday on a punt return, the Colts grabbed the lead, with quarterback Andrew Luck completing an 11-yard touchdown pass to wide receiver Darrius Heyward-Bey. The Broncos re-claimed the lead in the second quarter, with Manning throwing a 12-yard touchdown pass to tight end Julius Thomas. On the Broncos next possession, Colts' linebacker Robert Mathis forced a fumble off Manning out of the end zone, resulting in a safety. The Colts subsequently re-claimed the lead, with Luck connecting on a 20-yard touchdown pass to fullback Stanley Havili, then added to their lead, with an 8-yard touchdown pass from Luck to tight end Coby Fleener just before halftime. The Broncos' offense went three-and-out on their first three possessions of the third quarter, and the Colts took a 33-14 lead, with Luck rushing for a 10-yard touchdown. Late in the third quarter, the Broncos tried to cut into the Colts lead, with a 31-yard field goal by placekicker Matt Prater, but the Colts responded early in the fourth quarter, with a 52-yard field goal by Vinatieri. Trailing 36-17, the Broncos attempted a rally, with Manning connecting on a 31-yard touchdown pass to wide receiver Demaryius Thomas (with a failed two-point conversion attempt), followed by a 1-yard touchdown run by running back Knowshon Moreno. The latter score occurred after Broncos' safety Duke Ihenacho forced a fumble off Colts' running back Trent Richardson deep in Colts' territory. The Broncos' defense forced a punt on the Colts next possession. However, with 7:07 remaining in the fourth quarter, Manning's arm was hit by Colts' linebacker Erik Walden, and his pass was subsequently intercepted by linebacker Pat Angerer deep in Broncos' territory. Four plays later, a Vinatieri 42-yard field goal gave the Colts a 39-30 lead with 6:06 remaining. Eight plays into the Broncos' next possession, running back Ronnie Hillman lost a fumble at the Colts' 3-yard line at the 3:15 mark of the fourth quarter, just as the Broncos were attempting to narrow the Colts' lead. The Colts' offense subsequently ran time off the clock, forcing the Broncos to burn all three of their team timeouts. The Broncos tried a desperation rally with 1:28 remaining, with Prater nailing a 47-yard field goal with only 17 seconds remaining. However, the ensuing onside kick was unsuccessful, sealing the win for the Colts. With the loss, the Broncos' 17-game regular season winning streak was snapped. This marked Peyton Manning's first visit to Indianapolis since he was released by the Colts in March 2012. Manning was the Colts' starting quarterback from 1998-2010, before missing the entire 2011 season due to multiple neck surgeries.\",\"question\":\"How many touchdowns did the Broncos score in the first half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}