{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80c9e03a-6c76-5c4d-9415-f7fec500be56","task_key":"default--validation--e3aa621b~2d9f06~2d4e8a~2d8981~2d39dcf0b59ab2","task_revision_id":"1","upstream_id":"e3aa621b-9f06-4e8a-8981-39dcf0b59ab2","short_description":"How many yards difference was there between Josh Freeman's field goal and…","config":"default","split":"validation","body":"{\"passage\":\" Coming off their home loss to the Jets, the Bucs flew to Qwest Field for a week 15 duel against the Seattle Seahawks.  After a scoreless first quarter, Seattle got on the board first with QB Matt Hasselbeck's  29-yard pass to tight end John Carlson.  The Bucs got on the board with Connor Barth's 28-yard field goal to end the first half. In the third quarter, Tampa Bay took the lead after a 45-yard field goal and a 22-yard touchdown pass by QB Josh Freeman to running back Cadillac Williams, set up by a Tanard Jackson interception.  The Buccaneers further extended their lead with a 28-yard pass to running back Derrick Ward, with a successful two-point conversion.  In the fourth quarter, Barth kicked another field goal for 39 yards.  Seattle tried to rally, but Hasselbeck threw an interception (his fourth) in the end zone to cornerback Elbert Mack for a touchback. With the win, the Buccaneers improved to 2-12.  Not only was it their first road win since November 23, 2008, it also marked their first win on the west coast since winning Super Bowl XXXVII in San Diego and their first win in Seattle since 1999.\",\"question\":\"How many yards difference was there between Josh Freeman's field goal and touchdown pass?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}