{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3d405999-e5e7-55ee-8397-27e54329414d","task_key":"default--validation--18a23fc2~2de476~2d42e8~2dbe8d~2dde07cfa7ba24","task_revision_id":"1","upstream_id":"18a23fc2-e476-42e8-be8d-de07cfa7ba24","short_description":"Who scored more touchdowns, Erric Pegram and Bam Morris, or Yancey Thigpen?","config":"default","split":"validation","body":"{\"passage\":\"In 1995, the Steelers overcame a 3-4 start (including a 20-16 upset loss to the expansion 1995 Jacksonville Jaguars season) to win eight of their final nine games and finished with an  record, the second-best in the AFC. Their offense was led by quarterback Neil ODonnell, who completed 246 out of 416 passes for 2,970 yards and 17 touchdowns, with only seven interceptions. Pro Bowl wide receiver Yancey Thigpen was the teams leading receiver with 85 receptions for 1,307 yards and five touchdowns. Other contributors in the passing game included wide receivers Andre Hastings (48 catches for 502 yards and one touchdown) and Ernie Mills (39 receptions for 679 yards and 8 touchdowns), who both also excelled as returners on special teams. Mills gained 1,306 yards returning kickoffs, while Hastings returned 48 punts for 474 yards and a touchdown. The Steelers rushing attack was led by Erric Pegram, who recorded 813 yards and five touchdowns, and Bam Morris, who had 559 yards and nine touchdowns. On special teams, newly acquired kicker Norm Johnson led the NFL in both field goals made (34) and field goals attempted (41), while also successfully making all 39 of his extra point attempts.  Leading the offensive line was future Hall of Fame center Dermontti Dawson, who made the Pro Bowl for the third consecutive year.\",\"question\":\"Who scored more touchdowns,  Erric Pegram and Bam Morris, or Yancey Thigpen?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}