{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a892570-1daf-52ff-8f8e-ac6bff16790f","task_key":"default--validation--ff3b66cf~2d74ed~2d4f48~2dad46~2d1f55b6ee6dc4","task_revision_id":"1","upstream_id":"ff3b66cf-74ed-4f48-ad46-1f55b6ee6dc4","short_description":"How many more yard did Sanchez's 67 yard touch down compare to Henne's 11 yard…","config":"default","split":"validation","body":"{\"passage\":\" Coming off their win over the Vikings, the Dolphins went home, donned their alternate uniforms, and played their Week 3 home-opener against their AFC East foe, the New York Jets, on Sunday night.  Miami trailed early in the first quarter as Jets quarterback Mark Sanchez completed a 24-yard touchdown pass to tight end Dustin Keller.  The Dolphins' deficit would increase in the second quarter as Sanchez hooked up with Keller again on a 3-yard touchdown pass.  Miami would respond with quarterback Chad Henne completing a 3-yard touchdown pass to tight end Anthony Fasano, followed by kicker Dan Carpenter making a 44-yard field goal. The Dolphins would take the lead in the third quarter as Henne connected with wide receiver Brandon Marshall on an 11-yard touchdown pass, but New York would immediately respond as Sanchez found wide receiver Braylon Edwards on a 67-yard touchdown pass.  Miami would answer with Carpenter's 20-yard field goal.  In the fourth quarter, the Jets would add onto their lead as kicker Nick Folk got a 30-yard field goal.  The Dolphins would chip away as their deficit as Carpenter booted a 50-yard field goal, but New York would pull away as running back LaDainian Tomlinson got a 1-yard touchdown run.  Miami tried to rally, but the Jets' defense held on for the win.\",\"question\":\"How many more yard did Sanchez's 67 yard touch down compare to  Henne's 11 yard touch down?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}