{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"30a27468-8424-58a5-8f7c-7be15a80378e","task_key":"default--validation--e3bc192e~2d0b98~2d47fe~2db31f~2dab8ce6a48da7","task_revision_id":"1","upstream_id":"e3bc192e-0b98-47fe-b31f-ab8ce6a48da7","short_description":"Who threw the longer TD pass, Frye or Brees?","config":"default","split":"validation","body":"{\"passage\":\" The Saints opened the regular season on the road against the Cleveland Browns on September 10.  In the first half, kicker John Carney provided all of the Saints' first 9 points.  He put up a 43-yarder in the first, along with a 25 and a 21-yarder in the second quarter.  In the third quarter, the Browns offense finally got going as Cleveland quarterback Charlie Frye hooked up with TE Kellen Winslow on an 18-yard touchdown pass.  Fortunately, the Saints would respond with a 12-yard touchdown pass from quarterback Drew Brees to WR Marques Colston.  In the fourth quarter, the Browns came close with Frye getting a 1-yard touchdown run.  However, the Saints put the game away with Carney kicking a 20-yard FG to give the Saints the win. Despite not scoring a touchdown, RB Reggie Bush had a sound NFL debut, as he ran 14 times for 61 yards, caught 8 passes for 58 yards, and returned three punts for 22 Yards.  In total, he piled up 141 all-purpose yards.\",\"question\":\"Who threw the longer TD pass, Frye or Brees?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}