{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"688c4368-a2ec-5a0b-bac4-36a82c72bc1e","task_key":"default--validation--5c35081c~2d3c7f~2d4c30~2da2ef~2dcf013f46a38e","task_revision_id":"1","upstream_id":"5c35081c-3c7f-4c30-a2ef-cf013f46a38e","short_description":"How many field goals occurred in the game?","config":"default","split":"validation","body":"{\"passage\":\" The Eagles faced off with the Baltimore Ravens in an interconference matchup.  Both defenses dominated the first quarter, and in the second quarter, Baltimore forced three turnovers (two interceptions and a fumble) from Donovan McNabb.  Ravens kicker Matt Stover booted a 44-yard field goal, while quarterback Joe Flacco completed a 1-yard touchdown pass to tight end Daniel Wilcox.  However, rookie  Quintin Demps returned the following kickoff 100 yards for a Philadelphia touchdown to make it 10-7 Ravens at halftime.  Andy Reid decided to bench McNabb (who was 8-for-18 for 59 yards and two interceptions) and put backup quarterback Kevin Kolb into the game.  Kolb also struggled with the Baltimore defense, and the Eagles fell behind 12-7 when linebacker Jameel McClain blocked Sav Rocca's punt into the back of the endzone for a safety. In the fourth, the Ravens kicked another field goal after a Kolb interception, then Mark Clayton took a short slant 53-yards for a touchdown to make it 22-7.  Kolb drove Philadelphia to the Raven 1-yard line, but was intercepted in the end zone by Ed Reed, who returned the ball an NFL-record 108 yards for the touchdown.  Le'Ron McClain added a 1-yard touchdown run as Baltimore won 36-7.  Kolb was 10-for-23 for 73 yards and two interceptions, and Brian Westbrook had 39 yards rushing on 14 carries.  The Eagles dropped to 5-5-1.\",\"question\":\"How many field goals occurred in the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}