{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"71823c21-7b2e-5162-aa90-d0c504fbcbea","task_key":"default--validation--1c2634da~2d5598~2d4182~2d8544~2d12cdc45944e9","task_revision_id":"1","upstream_id":"1c2634da-5598-4182-8544-12cdc45944e9","short_description":"How many touchdown passes were thrown in the game?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their road win over the Bills, the Texans flew to Lucas Oil Stadium for a Week 9 AFC South duel with the Indianapolis Colts.  Houston would trail early in the first quarter as Colts quarterback Peyton Manning found running back Joseph Addai on a 7-yard touchdown pass, followed by a 22-yard field goal from kicker Matt Stover.  Indianapolis would increase their lead in the second quarter with Stover's 37-yard field goal, yet the Texans closed out the half with kicker Kris Brown nailing a 56-yard field goal. In the third quarter, Houston began to gain ground as quarterback Matt Schaub completed a 1-yard touchdown pass to running back Ryan Moats.  The Texans would take the lead in the fourth quarter as running back Steve Slaton got a 1-yard touchdown run, but the Colts retook the lead with running back Joseph Addai getting a 2-yard touchdown run.  Houston had a chance to tie the game with one second left in regulation, but Brown's 42-yard field goal attempt sailed wide left. In what was another close game resulting in a tough loss, the Texans went into their bye week at 5-4.\",\"question\":\"How many touchdown passes were thrown in the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}