{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dcf9ac77-7779-551a-8b04-bba0691faecc","task_key":"default--validation--cc6547d2~2d34c4~2d4fbd~2d8f13~2d186547338ddb","task_revision_id":"1","upstream_id":"cc6547d2-34c4-4fbd-8f13-186547338ddb","short_description":"Which player ran the ball in for a two yard touchdown?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their road win over the Bills, the Texans flew to Lucas Oil Stadium for a Week 9 AFC South duel with the Indianapolis Colts.  Houston would trail early in the first quarter as Colts quarterback Peyton Manning found running back Joseph Addai on a 7-yard touchdown pass, followed by a 22-yard field goal from kicker Matt Stover.  Indianapolis would increase their lead in the second quarter with Stover's 37-yard field goal, yet the Texans closed out the half with kicker Kris Brown nailing a 56-yard field goal. In the third quarter, Houston began to gain ground as quarterback Matt Schaub completed a 1-yard touchdown pass to running back Ryan Moats.  The Texans would take the lead in the fourth quarter as running back Steve Slaton got a 1-yard touchdown run, but the Colts retook the lead with running back Joseph Addai getting a 2-yard touchdown run.  Houston had a chance to tie the game with one second left in regulation, but Brown's 42-yard field goal attempt sailed wide left. In what was another close game resulting in a tough loss, the Texans went into their bye week at 5-4.\",\"question\":\"Which player ran the ball in for a two yard touchdown?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}