{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56033686-0501-5e68-89dc-e68eb46cd150","task_key":"default--validation--1c3fe698~2d79a8~2d4555~2dba05~2d35d507654b6a","task_revision_id":"1","upstream_id":"1c3fe698-79a8-4555-ba05-35d507654b6a","short_description":"How many points did the Pittsburgh get on their first possession?","config":"default","split":"validation","body":"{\"passage\":\" The Steelers began their anniversary season on the road against their AFC North foe, the Cleveland Browns, for Round 1 of the 2007 Rust Belt series.  Also, with both teams at 55 wins a piece, the Steelers would take the lead in the rivalry for the first time in the 57-year history of the rivalry. Pittsburgh got off to a fast start in the first quarter as QB Ben Roethlisberger completed a 5-yard TD pass to WR Hines Ward. Later, kicker Jeff Reed made a 26-yard field goal, while Roethlisberger completed a 40-yard TD pass to WR Santonio Holmes.  After a scoreless second quarter, the Steelers went right back to work in the third quarter, as Roethlisberger completed a 5-yard TD pass to rookie TE Matt Spaeth.  Afterwards, the Browns got their only score of the game as QB Derek Anderson completed a 1-yard TD pass to FB Lawrence Vickers.  Pittsburgh put the game well out of reach as Roethlisberger threw his career-best 4th touchdown pass of the game, a 22-yard strike to TE Heath Miller.  In the fourth quarter, Pittsburgh wrapped up the win with Reed's 31-yard field goal. With the win, the Steelers began the year at 1-0, gave Mike Tomlin his first win as a head coach, and took the lead in the Rust Belt series with win #56. Q1 - PIT - 11:49 - 5-yard TD pass from Ben Roethlisberger to Hines Ward (Jeff Reed kick) (7-0 PIT)Q1 - PIT - 8:53 - Jeff Reed 26-yard FG (14-0 PIT)Q1 - PIT - 0:58 - 40-yard TD pass from Ben Roethlisberger to Santonio Holmes (Reed kick) (17-0 PIT)Q3 - PIT - 10:33 - 5-yard TD pass from Ben Roethlisberger to Matt Spaeth (Reed kick) (24-0 PIT)Q3 - CLE - 6:52 - 1-yard TD pass from Derek Anderson to Lawrence Vickers (Phil Dawson kick) (24-7 PIT)Q3 - PIT - 2:23 - 22-yard TD pass from Ben Roethlisberger to Heath Miller (Reed kick) (31-7 PIT)Q4 - PIT - 7:12 - Jeff Reed 31-yard FG (34-7 PIT)\",\"question\":\"How many points did the Pittsburgh get on their first possession?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}