{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"59c5ddfc-6196-5902-adb2-f98df14790a9","task_key":"default--validation--513c00fd~2d9f5f~2d468c~2d8ac5~2d8f87b41f3fee","task_revision_id":"1","upstream_id":"513c00fd-9f5f-468c-8ac5-8f87b41f3fee","short_description":"How many yards did the longest touchdown run go for?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their bye week, the Colts flew to the Edward Jones Dome for a Week 7 interconference duel with the St. Louis Rams.  Indianapolis came out of the gates early in the first quarter as quarterback Peyton Manning completed a six-yard touchdown pass to wide receiver Reggie Wayne.  The Rams would respond with a 30-yard field goal from kicker Josh Brown, yet the Colts answered with Manning hooking up with tight end Dallas Clark on a 22-yard touchdown pass.  Afterwards, running back Joseph Addai would acquire the only score of the second quarter with a six-yard touchdown. St. Louis would begin the third quarter with Brown booting a 45-yard field goal, yet Indianapolis calmly responded with rookie cornerback Jacob Lacey returning an interception 35 yards for a touchdown.  Afterwards, the Colts closed out the game with Manning finding rookie wide receiver Austin Collie on an eight-yard touchdown pass and running back Chad Simpson getting a 31-yard touchdown run. With the win, Indianapolis improved to 6-0 and increased their winning streak to 14 games.\",\"question\":\"How many yards did the longest touchdown run go for?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}