{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ee2d570-ad85-5480-bb86-6aa11b1b8d6f","task_key":"default--validation--c8394254~2d70fd~2d4366~2d85e3~2d502c66458edd","task_revision_id":"1","upstream_id":"c8394254-70fd-4366-85e3-502c66458edd","short_description":"How many more spectators were at Old Trafford in 1986 for the first test of the…","config":"default","split":"validation","body":"{\"passage\":\" Coming off their bye week, the Colts flew to the Edward Jones Dome for a Week 7 interconference duel with the St. Louis Rams.  Indianapolis came out of the gates early in the first quarter as quarterback Peyton Manning completed a six-yard touchdown pass to wide receiver Reggie Wayne.  The Rams would respond with a 30-yard field goal from kicker Josh Brown, yet the Colts answered with Manning hooking up with tight end Dallas Clark on a 22-yard touchdown pass.  Afterwards, running back Joseph Addai would acquire the only score of the second quarter with a six-yard touchdown. St. Louis would begin the third quarter with Brown booting a 45-yard field goal, yet Indianapolis calmly responded with rookie cornerback Jacob Lacey returning an interception 35 yards for a touchdown.  Afterwards, the Colts closed out the game with Manning finding rookie wide receiver Austin Collie on an eight-yard touchdown pass and running back Chad Simpson getting a 31-yard touchdown run. With the win, Indianapolis improved to 6-0 and increased their winning streak to 14 games.\",\"question\":\"How many more spectators were at Old Trafford in 1986 for the first test of the Kangaroo tour of Great Britain and France than the 1989 World Cup Challenege?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}