{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9d03ed0f-6ec2-5788-96f9-a45be545874e","task_key":"default--validation--17f52fd9~2d807f~2d4429~2d804c~2d0f044cd81319","task_revision_id":"1","upstream_id":"17f52fd9-807f-4429-804c-0f044cd81319","short_description":"How many more touchdowns did Arizona score than Seattle in the first half?","config":"default","split":"validation","body":"{\"passage\":\" Hoping to build off of their home win over the Buccaneers, the Seahawks flew to the University of Phoenix Stadium for a Week 2 divisional duel with the Arizona Cardinals. RB Shaun Alexander sported a cast on his left wrist, the result of a reported sprain suffered in the opening week. In the first quarter, Seattle trailed early as kicker Neil Rackers booted a 28-yard field goal for the only score of the period.  In the second quarter, the 'Hawks continued to trail as Cardinals QB Matt Leinart threw a 30-yard TD pass to TE Leonard Pope, along with RB Edgerrin James getting a 17-yard TD run.  Down 17-0, the Seahawks would respond just before halftime with QB Matt Hasselbeck completing a 24-yard TD pass to WR Nate Burleson. Arizona quickly moved into field goal range after the Seahawk TD, but Rackers hit the upright from 53 yards as time expired. In the third quarter, Seattle would come all the way back to tie the game after RB Shaun Alexander finally broke loose for a 16-yard TD run and kicker Josh Brown booted a 28-yard field goal.  In the fourth quarter, the Seahawks took the lead with Brown kicking another 28-yard field goal.  However, Arizona rallied to tie the game on a Rackers 52-yard field goal.  The Seahawks appeared to be driving for the go ahead score when, inside field goal range in the final 2 minutes, an exchange from Hasselbeck to Alexander was fumbled and recovered by the Cardinals. Arizona then drove to the Seahawks' 25-yard line, where Rackers kicked a game-winning 42-yard field goal with 11 seconds left. With the loss, the Seahawks fell to 1-1 on the young season, and had lost 4 straight divisional games.\",\"question\":\"How many more touchdowns did Arizona score than Seattle in the first half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}