{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f1b2a967-9e8e-5631-b49c-83dcdd44210b","task_key":"default--validation--7948a15d~2d7636~2d49c3~2d809f~2d5cdd2c49c807","task_revision_id":"1","upstream_id":"7948a15d-7636-49c3-809f-5cdd2c49c807","short_description":"Who caught the longest touchdown pass of the game?","config":"default","split":"validation","body":"{\"passage\":\" After a miserable loss to the Atlanta Falcons, the Dolphins host their home opener to the Indianapolis Colts. On the first play from scrimmage, Peyton Manning threw an 80-yard touchdown pass to tight end Dallas Clark. The Dolphins answered with a 14-yard touchdown run by Ronnie Brown out of the Wildcat Offense. The Dolphins and Colts kept going back and forth at each other with two field goals by Dan Carpenter and Adam Vinatieri to make the score 13-13 at halftime. After a scoreless third quarter, Ronnie Brown ran 2-yards for a touchdown to put Miami up 20-13. The Colts answered back with a 15-yard touchdown run by rookie running back Donald Brown. Miami than hit a 45-yard field goal by Dan Carpenter. But the Colts took the lead thanks to a 48-yard touchdown pass to Pierre Garçon. The Dolphins tried to rally at the end of the game but Chad Pennington was intercepted by Antoine Bethea to sucure the Colts victory. The Colts won the game 27-23 as the Dolphins dropped to 0-2. The Dolphins dominated the game in the time of possession battle, but lost the game with almost 50 minutes of offensive possession.\",\"question\":\"Who caught the longest touchdown pass of the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}