{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"59c9774e-8fb7-5ee0-9bef-03662652d09a","task_key":"default--validation--061d4673~2d83f2~2d4de7~2dbde8~2dad2f7cd0a82d","task_revision_id":"1","upstream_id":"061d4673-83f2-4de7-bde8-ad2f7cd0a82d","short_description":"How many more touchdowns did Gronkowski have in the second half than the first?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their win over the Eagles, the Patriots returned home for an AFC duel with the Indianapolis Colts. The Patriots took the early lead, with a 39-yard field goal by Stephen Gostkowski, before placekicker and former Patriots Super Bowl hero Adam Vinateri hit back with a 31-yard field goal of his own early in the second quarter. The Patriots then reeled off 28 unanswered points, starting with quarterback Tom Brady tossing an 11-yard touchdown pass to tight end Rob Gronkowski, a 1-yard touchdown run by running back BenJarvus Green-Ellis just before halftime, then Brady threw two more touchdown passes to Gronkowski in the third quarter - a 21-yarder followed by a 2-yarder. In the fourth quarter, the Patriots were held scoreless and the Colts reeled off 21 unanswered points - a 5-yard touchdown run by running back Donald Brown, followed by two touchdown passes from Dan Orlovsky to wide receiver Pierre Garçon - a 33-yarder and a 12-yarder - the latter with 36 seconds remaining in regulation. Despite the touchdowns, one of Garçon's catches in the end zone was accompanied with an angry throw at a sign with a target meant for Gronkowski's trademark spike. A Colts' onside kick attempt near the end of the contest was unsuccessful, sealing the win for the Patriots.\",\"question\":\"How many more touchdowns did Gronkowski have in the second half than the first?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}