{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e1ed52f6-6c6e-54b3-8df7-97ec35dabe80","task_key":"default--validation--782eab23~2dc23f~2d47f5~2db0e1~2da2a9ba11d49c","task_revision_id":"1","upstream_id":"782eab23-c23f-47f5-b0e1-a2a9ba11d49c","short_description":"Who threw the last touchdown pass of the game?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their bye week, the Patriots flew to Ralph Wilson Stadium for a rematch with their AFC East rival, the Buffalo Bills.  Dillon got the Patriots off to an early start with an eight-yard touchdown run.  Even though Bills' Rian Lindell got Buffalo on the board with a 40-yard field goal, Dillon again helped the Patriots increase their lead with a 12-yard touchdown run.  After a scoreless second quarter, Brady hooked up with Jackson on a 35-yard touchdown pass for the only score of the period.  In the fourth quarter, Lindell would add a 46-yard field goal, but Brady put the game away with a five-yard touchdown pass to Gabriel, giving New England the season sweep over Buffalo and a 5-1 record.\",\"question\":\"Who threw the last touchdown pass of the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}