{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1d937336-7bfd-5966-8072-20a3aef7954e","task_key":"default--validation--9e233e12~2d5359~2d4f1d~2da465~2db2962d000f28","task_revision_id":"1","upstream_id":"9e233e12-5359-4f1d-a465-b2962d000f28","short_description":"Which team scored first in the second half?","config":"default","split":"validation","body":"{\"passage\":\" The Eagles, who had not won on prime time in two years, faced off against the defending Super Bowl champion   New York Giants on a Sunday night game at Lincoln Financial Field.  Mike Patterson batted up and intercepted Eli Manning, returning the ball inside the New York 10-yard line.  Two plays later DeSean Jackson took the direct snap and rushed 9-yards, diving to the pylon for a touchdown less than two minutes into the game.  Manning then led the Giants up the field and he found Plaxico Burress for a 17-yard touchdown.  The Eagles fumbled the kickoff, and New York cashed in for a field goal.  On New York's next drive, Manning capped off another long drive with a short touchdown pass to Kevin Boss to take a 17-7 lead early in the second quarter.  A fumble by Giant rusher Brandon Jacobs gave Philadelphia the ball in New York territory.  Six plays later, Donovan McNabb completed a 10-yard pass to Jason Avant for an Eagle touchdown.  Sam Madison picked off McNabb deep in Eagle territory on the next drive, but the Giants settled for a field goal to make it 20-14.  McNabb ran the two-minute drill before the half to get the Eagles a 29-yard field goal before halftime, narrowing the score to 20-17.  After a good kickoff return by rookie Quintin Demps, the Eagles navigated the short field for another touchdown, this one a fade to Hank Baskett and a 24-20 Philadelphia lead.  The Giants, continuing to have success with their ground game, drove down the field.  On a critical 3rd-and-10 from the Eagle 20-yard line, Manning completed a 17-yard pass to Boss, but was flagged for crossing the line of scrimmage.  Giants' coach Tom Coughlin challenged the call, and it was reversed, giving New York 1st-and-goal.  They scored when Jacobs powered forward on a 3-yard run.  Another long Giant drive led to a field goal early in the fourth quarter making it 30-24 Giants.  The Giants scored again on their next drive, a 3-yard rush by Jacobs.  Andy Reid challenged consecutive plays at the end of the drive, but lost both of them, leaving the Eagles with only one timeout, 9:30 left to play, and a 36-24 deficit (after New York missed on the two-point conversion).  A 32-yard completion to DeSean Jackson jump-started the offense, and McNabb hit Kevin Curtis for a 2-yard touchdown on fourth down to keep Philadelphia alive.  The Eagles got the ball back with 3:14 left, but could not convert on a 4th-and-1 near midfield to lose the game 36-31.  McNabb had three touchdown passes, but Brian Westbrook was limited to just 26 yards on 13 carries.  Jacobs rushed for 126 yards and two touchdowns for the Giants.  The Eagles fell to 5-4, 0-3 in their division.\",\"question\":\"Which team scored first in the second half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}