{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2dc26b13-edcb-5596-b146-b44842f04c69","task_key":"default--validation--4a62ead9~2d01c2~2d4a47~2d950b~2d5afb182afbc3","task_revision_id":"1","upstream_id":"4a62ead9-01c2-4a47-950b-5afb182afbc3","short_description":"How many times did Rashard Mendenhall ruish for a td?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their impressive road win over the Buccaneers, the Steelers went home for an AFC North duel with the Baltimore Ravens.  Pittsburgh would deliver the opening punch in the first quarter with a 1-yard touchdown run from running back Rashard Mendenhall.  The Ravens would take the lead in the second quarter as running back Willis McGahee got a 9-yard touchdown run, followed by kicker Billy Cundiff getting a 33-yard field goal.  After a scoreless third quarter, the Steelers would regain the lead as Mendenhall picked up a 7-yard touchdown run.  However, Baltimore would get the last laugh as quarterback Joe Flacco completed an 18-yard touchdown pass to wide receiver T. J. Houshmandzadeh with 33 seconds remaining. The Steelers would get the ball back with 20 seconds remaining but quarterback Charlie Batch threw a pass that was picked off by linebacker Ray Lewis, effectively ending the game. With the loss, Pittsburgh went into their bye week at 3-1.\",\"question\":\"How many times did Rashard Mendenhall ruish for a td?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}