{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"815c3fe3-ae8e-54a9-956a-33266f7bc386","task_key":"default--validation--bc21502d~2dfe35~2d42ae~2d9fb5~2df0aca148e7ea","task_revision_id":"1","upstream_id":"bc21502d-fe35-42ae-9fb5-f0aca148e7ea","short_description":"How many field goals did Nick Folk make?","config":"default","split":"validation","body":"{\"passage\":\" Still looking for their first win of the season, the Bills went home, donned their throwback uniforms, and played a Week 4 AFC East duel with the New York Jets.  Buffalo would trail early in the first quarter as Jets running back LaDainian Tomlinson got a 1-yard touchdown run.  New York would add onto their lead in the second quarter as kicker Nick Folk nailed a 19-yard field goal, followed by quarterback Mark Sanchez completing a 41-yard touchdown pass to wide receiver Braylon Edwards.  Buffalo would close out the half as quarterback Ryan Fitzpatrick connected with tight end David Martin on a 4-yard touchdown pass. In the third quarter, the Jets would greatly extend their lead with tight end Dustin Keller catching a 3-yard touchdown pass from wide receiver/quarterback Brad Smith, followed by his 2-yard touchdown reception from Sanchez.  Afterwards, Tomlinson would help secure the win for New York with his 26-yard touchdown run.  The Bills would close out the game in the fourth quarter as Fitzpatrick completed a 13-yard touchdown pass to wide receiver Steve Johnson. With the loss, Buffalo fell to 0-4. Two days later, Marshawn Lynch was traded to the Seattle Seahawks in exchange for a fourth-round draft pick in the 2011 draft and a conditional pick in the 2012 draft, and tackle Jamon Meredith was waived.\",\"question\":\"How many field goals did Nick Folk make?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}