{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2d531890-27d8-5b5a-b101-e2ccb73bb540","task_key":"default--validation--132289e8~2db061~2d473f~2d8572~2d378592d688f5","task_revision_id":"1","upstream_id":"132289e8-b061-473f-8572-378592d688f5","short_description":"How many yards was the longest touchdown run?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their bye week, the Patriots flew to Ralph Wilson Stadium for a rematch with their AFC East rival, the Buffalo Bills.  Dillon got the Patriots off to an early start with an eight-yard touchdown run.  Even though Bills' Rian Lindell got Buffalo on the board with a 40-yard field goal, Dillon again helped the Patriots increase their lead with a 12-yard touchdown run.  After a scoreless second quarter, Brady hooked up with Jackson on a 35-yard touchdown pass for the only score of the period.  In the fourth quarter, Lindell would add a 46-yard field goal, but Brady put the game away with a five-yard touchdown pass to Gabriel, giving New England the season sweep over Buffalo and a 5-1 record.\",\"question\":\"How many yards was the longest touchdown run?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}