{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"90d98c92-c6de-58e1-aee0-11f17a6a4ef4","task_key":"default--validation--642915d1~2d04b2~2d4851~2d8adb~2d220e9604aba9","task_revision_id":"1","upstream_id":"642915d1-04b2-4851-8adb-220e9604aba9","short_description":"How many yards shorter was David Akers's second field goal compared to his first…","config":"default","split":"validation","body":"{\"passage\":\" Following a Saturday thrashing over the Falcons, the Cowboys returned home, donned their 1960s throwbacks again, and prepared for an NFC East rematch on Christmas Day with the Philadelphia Eagles.  In the first quarter, the 'Boys trailed early with QB Jeff Garcia completing a 25-yard TD pass to TE Matt Schobel for the only score of the period.  In the second quarter, Philadelphia's lead increased with kicker David Akers nailing a 25-yard field goal.  Dallas would get its only score of the game with QB Tony Romo completing a 14-yard TD pass to WR Terrell Owens.  Afterwards, the Eagles wrapped up the half with Akers kicking a 45-yard field goal.  In the third quarter, Philly's lead increased with Akers' 21-yard field goal for the only score of the period.  In the fourth quarter, Dallas fell with RB Correll Buckhalter's 1-yard TD run.  With the loss, the Cowboys fell to 9-6 and out of first place in the NFC East.Stats\",\"question\":\"How many yards shorter was David Akers's second field goal compared to his first one?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}