{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd704bb3-493f-57f3-9b24-6ee7e9c06721","task_key":"default--validation--b0dc36a1~2dd1b5~2d4d56~2db52b~2d4a25562202a1","task_revision_id":"1","upstream_id":"b0dc36a1-d1b5-4d56-b52b-4a25562202a1","short_description":"Which kicker had more field goals?","config":"default","split":"validation","body":"{\"passage\":\" The Redskins donned their burgundy uniforms and played at home against the Pittsburgh Steelers in a special pre-election day edition of Monday Night Football. The Steelers opened the game with a failed onside kick attempt which gave the Redskins position at their opponent's 41-yard line. The drive ended with a Shaun Suisham field goal. The Redskins regained possession on a tipped Ben Roethlisberger pass that was intercepted by Cornelius Griffin early in the first quarter. The drive resulted in another field goal giving Washington a 6-0 lead over the Steelers. In the second quarter, Steelers' Jeff Reed scored on a 35-yard field goal. Pittsburgh took the lead as they turned a blocked Ryan Plackemeier punt attempt into a 1-yard touchdown run by Roethlisberger, who exited the game following the score due to an injury to his shoulder and would not return. In the second half, Byron Leftwich entered the game for the injured Roethlisberger. Pittsburgh rusher Willie Parker ran for a touchdown in the third quarter (with a failed extra point). Early in the fourth quarter, Leftwich completed a 5-yard touchdown reception to Santonio Holmes, giving the Steelers a 23-6 lead. Jason Campbell appeared to score a rushing touchdown later in the quarter but the ruling was reversed on a Pittsburgh challenge. Byron Leftwich played for only one half and threw for 129 yards. Clinton Portis was held to 51 yards rushing. Jason Campbell was sacked seven times. His streak of avoiding an interception also ended at 249 pass attempts.\",\"question\":\"Which kicker had more field goals?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}