{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"480330e1-8e8d-5f5a-82c3-68951e424f12","task_key":"default--validation--213f1c2f~2d8dbe~2d4e55~2da89c~2d16959a0c378e","task_revision_id":"1","upstream_id":"213f1c2f-8dbe-4e55-a89c-16959a0c378e","short_description":"How many points did Joseph Addai score in the second quarter?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their bye week, the Colts flew to the Edward Jones Dome for a Week 7 interconference duel with the St. Louis Rams.  Indianapolis came out of the gates early in the first quarter as quarterback Peyton Manning completed a six-yard touchdown pass to wide receiver Reggie Wayne.  The Rams would respond with a 30-yard field goal from kicker Josh Brown, yet the Colts answered with Manning hooking up with tight end Dallas Clark on a 22-yard touchdown pass.  Afterwards, running back Joseph Addai would acquire the only score of the second quarter with a six-yard touchdown. St. Louis would begin the third quarter with Brown booting a 45-yard field goal, yet Indianapolis calmly responded with rookie cornerback Jacob Lacey returning an interception 35 yards for a touchdown.  Afterwards, the Colts closed out the game with Manning finding rookie wide receiver Austin Collie on an eight-yard touchdown pass and running back Chad Simpson getting a 31-yard touchdown run. With the win, Indianapolis improved to 6-0 and increased their winning streak to 14 games.\",\"question\":\"How many points did Joseph Addai score in the second quarter?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}