{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d953bd9b-4347-5b47-9a39-728f504e5333","task_key":"default--validation--a3063725~2dadba~2d4756~2dae46~2d2c2ced3bb171","task_revision_id":"1","upstream_id":"a3063725-adba-4756-ae46-2c2ced3bb171","short_description":"Who threw the longest touchdown pass?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their bye week, the Colts flew to the Edward Jones Dome for a Week 7 interconference duel with the St. Louis Rams.  Indianapolis came out of the gates early in the first quarter as quarterback Peyton Manning completed a six-yard touchdown pass to wide receiver Reggie Wayne.  The Rams would respond with a 30-yard field goal from kicker Josh Brown, yet the Colts answered with Manning hooking up with tight end Dallas Clark on a 22-yard touchdown pass.  Afterwards, running back Joseph Addai would acquire the only score of the second quarter with a six-yard touchdown. St. Louis would begin the third quarter with Brown booting a 45-yard field goal, yet Indianapolis calmly responded with rookie cornerback Jacob Lacey returning an interception 35 yards for a touchdown.  Afterwards, the Colts closed out the game with Manning finding rookie wide receiver Austin Collie on an eight-yard touchdown pass and running back Chad Simpson getting a 31-yard touchdown run. With the win, Indianapolis improved to 6-0 and increased their winning streak to 14 games.\",\"question\":\"Who threw the longest touchdown pass?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}