{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e4f1ad0f-f7cb-5357-85b0-8e5a88f56716","task_key":"default--validation--a3e2a571~2d2051~2d442b~2da411~2d7110f7f204b2","task_revision_id":"1","upstream_id":"a3e2a571-2051-442b-a411-7110f7f204b2","short_description":"Who scored the final points of the game?","config":"default","split":"validation","body":"{\"passage\":\" Hoping to rebound from their divisional home loss to the Buccaneers, the Saints flew to the Georgia Dome for a Week 14 Monday Night NFC South rematch with the Atlanta Falcons.  In the first quarter, New Orleans drew first blood as QB Drew Brees completed a 25-yard TD pass to WR David Patten.  The Falcons would respond with QB Chris Redman completing a 33-yard TD pass to WR Roddy White.  In the second quarter, the Saints started to pull away as kicker Olindo Mare managed to get a 23-yard field goal, while Brees completed a 15-yard TD pass to WR Marques Colston. In the third quarter, New Orleans pulled away as Brees hooked up with Colston again on a 2-yard TD pass, while Safety Roman Harper returned an interception 31 yards for a touchdown.  In the fourth quarter, Atlanta would get their last strike of the game as Redman completed a 13-yard TD pass to WR Michael Jenkins.  The Saints would wrap up their victory with Mare nailing a 36-yard field goal. With their second-straight season-sweeping win over the Falcons, New Orleans improved to 6-7.\",\"question\":\"Who scored the final points of the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}