{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d5dab2ed-4065-5f9c-885e-f413c602e700","task_key":"default--validation--1791c263~2dae83~2d4c6f~2d9a8c~2d76f510902cb9","task_revision_id":"1","upstream_id":"1791c263-ae83-4c6f-9a8c-76f510902cb9","short_description":"Which team had the most wins before this match began?","config":"default","split":"validation","body":"{\"passage\":\" The Steelers began their anniversary season on the road against their AFC North foe, the Cleveland Browns, for Round 1 of the 2007 Rust Belt series.  Also, with both teams at 55 wins a piece, the Steelers would take the lead in the rivalry for the first time in the 57-year history of the rivalry. Pittsburgh got off to a fast start in the first quarter as QB Ben Roethlisberger completed a 5-yard TD pass to WR Hines Ward. Later, kicker Jeff Reed made a 26-yard field goal, while Roethlisberger completed a 40-yard TD pass to WR Santonio Holmes.  After a scoreless second quarter, the Steelers went right back to work in the third quarter, as Roethlisberger completed a 5-yard TD pass to rookie TE Matt Spaeth.  Afterwards, the Browns got their only score of the game as QB Derek Anderson completed a 1-yard TD pass to FB Lawrence Vickers.  Pittsburgh put the game well out of reach as Roethlisberger threw his career-best 4th touchdown pass of the game, a 22-yard strike to TE Heath Miller.  In the fourth quarter, Pittsburgh wrapped up the win with Reed's 31-yard field goal. With the win, the Steelers began the year at 1-0, gave Mike Tomlin his first win as a head coach, and took the lead in the Rust Belt series with win #56. Q1 - PIT - 11:49 - 5-yard TD pass from Ben Roethlisberger to Hines Ward (Jeff Reed kick) (7-0 PIT)Q1 - PIT - 8:53 - Jeff Reed 26-yard FG (14-0 PIT)Q1 - PIT - 0:58 - 40-yard TD pass from Ben Roethlisberger to Santonio Holmes (Reed kick) (17-0 PIT)Q3 - PIT - 10:33 - 5-yard TD pass from Ben Roethlisberger to Matt Spaeth (Reed kick) (24-0 PIT)Q3 - CLE - 6:52 - 1-yard TD pass from Derek Anderson to Lawrence Vickers (Phil Dawson kick) (24-7 PIT)Q3 - PIT - 2:23 - 22-yard TD pass from Ben Roethlisberger to Heath Miller (Reed kick) (31-7 PIT)Q4 - PIT - 7:12 - Jeff Reed 31-yard FG (34-7 PIT)\",\"question\":\"Which team had the most wins before this match began?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}