{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ffca7c15-4212-5830-86f3-a1477e64e90d","task_key":"default--validation--17ac6950~2db72e~2d4b45~2d80be~2d2d69a3c741f1","task_revision_id":"1","upstream_id":"17ac6950-b72e-4b45-80be-2d69a3c741f1","short_description":"How many field goals did the steelers kick?","config":"default","split":"validation","body":"{\"passage\":\" The Steelers began their anniversary season on the road against their AFC North foe, the Cleveland Browns, for Round 1 of the 2007 Rust Belt series.  Also, with both teams at 55 wins a piece, the Steelers would take the lead in the rivalry for the first time in the 57-year history of the rivalry. Pittsburgh got off to a fast start in the first quarter as QB Ben Roethlisberger completed a 5-yard TD pass to WR Hines Ward. Later, kicker Jeff Reed made a 26-yard field goal, while Roethlisberger completed a 40-yard TD pass to WR Santonio Holmes.  After a scoreless second quarter, the Steelers went right back to work in the third quarter, as Roethlisberger completed a 5-yard TD pass to rookie TE Matt Spaeth.  Afterwards, the Browns got their only score of the game as QB Derek Anderson completed a 1-yard TD pass to FB Lawrence Vickers.  Pittsburgh put the game well out of reach as Roethlisberger threw his career-best 4th touchdown pass of the game, a 22-yard strike to TE Heath Miller.  In the fourth quarter, Pittsburgh wrapped up the win with Reed's 31-yard field goal. With the win, the Steelers began the year at 1-0, gave Mike Tomlin his first win as a head coach, and took the lead in the Rust Belt series with win #56. Q1 - PIT - 11:49 - 5-yard TD pass from Ben Roethlisberger to Hines Ward (Jeff Reed kick) (7-0 PIT)Q1 - PIT - 8:53 - Jeff Reed 26-yard FG (14-0 PIT)Q1 - PIT - 0:58 - 40-yard TD pass from Ben Roethlisberger to Santonio Holmes (Reed kick) (17-0 PIT)Q3 - PIT - 10:33 - 5-yard TD pass from Ben Roethlisberger to Matt Spaeth (Reed kick) (24-0 PIT)Q3 - CLE - 6:52 - 1-yard TD pass from Derek Anderson to Lawrence Vickers (Phil Dawson kick) (24-7 PIT)Q3 - PIT - 2:23 - 22-yard TD pass from Ben Roethlisberger to Heath Miller (Reed kick) (31-7 PIT)Q4 - PIT - 7:12 - Jeff Reed 31-yard FG (34-7 PIT)\",\"question\":\"How many field goals did the steelers kick?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}