{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98d655c0-893a-557f-8942-568ac1965797","task_key":"default--validation--bdcc289c~2d0316~2d4dfa~2d81e9~2de36e777b9a28","task_revision_id":"1","upstream_id":"bdcc289c-0316-4dfa-81e9-e36e777b9a28","short_description":"How many touchdowns did Marvin Harrison score in the second quarter?","config":"default","split":"validation","body":"{\"passage\":\" Hoping to rebound from their blowout road loss to the Jaguars, the Colts went home for a Monday Night Football matchup with the Cincinnati Bengals. In the first quarter, Indianapolis struck first with K Adam Vinatieri nailing a 30-yard field goal. The Bengals would respond with K Shayne Graham converting a 27-yard field goal. In the second quarter, the Colts began their breakout with QB Peyton Manning completing a 4-yard touchdown pass to WR Marvin Harrison. Harrison would end up catching three touchdown passes in this game. Even though Cincinnati responded with 12-yard touchdown run by RB Rudi Johnson, Indianapolis responded with Manning completing a 3-yard touchdown pass to Harrison. In the third quarter, the Bengals converted another field goal, and the Colts continued their power with Manning completing another touchdown pass to Marvin Harrison. Afterwards, Manning would complete another touchdown pass, this one an 18-yarder to WR Reggie Wayne. In the fourth quarter, the Bengals' only response was another field goal. After that last field goal by Shayne Graham, Adam Vinatieri responded with a 44-yard field goal to close out the game. With the win, the Colts improved to 11-3. Colts QB Peyton Manning finished the game 29 of 36 for 282 yards with four touchdowns and no interceptions, while Bengals QB Carson Palmer was 14 of 28 for 176 passing yards. Palmer also fumbled the football four times in this game. Colts DE Dwight Freeney forced three fumbles in the game and also had three sacks on Carson Palmer.\",\"question\":\"How many touchdowns did Marvin Harrison score in the second quarter?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}