{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7bea31c3-2b40-5f79-a4b2-d88160461812","task_key":"default--validation--fab4ed2d~2ddac4~2d442e~2db063~2d0339b0007cc3","task_revision_id":"1","upstream_id":"fab4ed2d-dac4-442e-b063-0339b0007cc3","short_description":"How many percent of his passes did McNabb not complete?","config":"default","split":"validation","body":"{\"passage\":\"In 2004 Philadelphia Eagles season, the Philadelphia Eagles had their best season since 1960, going 13-1 before resting their starters and losing their next 2, clinching the number one seed for the second year in a row. McNabb set career highs, completing 64% of his passes for 3,875 yards, though he didnt play all 16 games. McNabb became the first quarterback ever to throw more than 30 touchdowns and fewer than 10 interceptions in a season. His success could be attributed to the fact that he had a reliable receiver, Terrell Owens, who got 1,200 yards and 14 touchdowns in 14 games. After defeating the Minnesota Vikings and Atlanta Falcons, the Eagles advanced to Super Bowl XXXIX, where they dueled the 2004 New England Patriots season. Although McNabb threw 3 touchdown passes and 357 yards in the game, and the score was tied 14-14 going into the fourth quarter, the Patriots outscored the Eagles and scored ten straight points. McNabb completed a 30-yard touchdown pass, and the Eagles defense held the Patriots to a 3 and out, but a crucial interception with 46 seconds left on the clock secured their fate. The Patriots won 24-21.\",\"question\":\"How many percent of his passes did McNabb not complete?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}