{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e6aa71c4-fe7b-5cbf-afa2-4153e7b6d78e","task_key":"default--validation--dd5a3b63~2d8bdf~2d4da0~2d96be~2dc6d59054fd09","task_revision_id":"1","upstream_id":"dd5a3b63-8bdf-4da0-96be-c6d59054fd09","short_description":"How many yards was the longest touchdown pass?","config":"default","split":"validation","body":"{\"passage\":\" at Lincoln Financial Field, Philadelphia|weather= 60 °F (Clear)Following their dominating road win over the 49ers, the Eagles returned home for a Monday Night match-up with the Green Bay Packers.  Early in the game, the Eagles offense struggled with two goal-line fumbles being recovered by the Packers.  In the first quarter, Packers kicker Dave Rayner nailed a 23-yard field goal for the only score of the period.  In the second quarter, Philadelphia would score on QB Donovan McNabb's 6-yard TD run.  However, Green Bay managed to get two more field goals, as Rayner got a 54-yarder and a 46-yarder to end the half.  In the second half, it was all Eagles, as in the third quarter, kicker David Akers got a 40-yard field goal, while McNabb and WR Greg Lewis connected on two touchdown passes of 45 and 30 yards.  In the fourth quarter, the Philly offense wrapped things up as McNabb got a 15-yard TD run, while the defense ended the game on a goal-line stand.  With their victory, the Eagles managed to get their first home win of the season as the team improved to 3-1.\",\"question\":\"How many yards was the longest touchdown pass?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}