{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cc8076c4-c83a-57b6-84fb-25170e71b2ec","task_key":"default--validation--62adf2f2~2ded66~2d48a7~2db5f6~2d5a97e0cab815","task_revision_id":"1","upstream_id":"62adf2f2-ed66-48a7-b5f6-5a97e0cab815","short_description":"How many field goals did Carney kick in the second half?","config":"default","split":"validation","body":"{\"passage\":\" at the Louisiana Superdome, New Orleans, Louisiana Following two-straight wins over two division opponents (the Bucs and the Panthers), the Falcons flew to the Louisiana Superdome to take on the New Orleans Saints (who were playing in the Superdome for the first time since Dec. '04) for an NFC South match-up on Monday Night.  From the get-go the Falcons trailed, when they had a punt blocked by Saints safety Steve Gleason and DB Curtis Deloatch landed on the ball in the end zone for the touchdown.  The Falcons would respond, as kicker Morten Andersen (who used to play for the Saints) kicked a 26-yard field goal.  That would be their only score of the night, as WR Devery Henderson ran for an 11-yard TD on a reverse.  Then, Saints kicker John Carney would provide the remaining points for the New Orleans, as he kicked two field goals in the second quarter (a 37-yarder and a 51-yarder) and one field goal in the third (a 20-yarder).  The Falcons would fall to 2-1, as their offense got swapped, battered, and bruised.  QB Michael Vick got sacked five times, while he and RB Warrick Dunn would only combine for 101 rushing yards.\",\"question\":\"How many field goals did Carney kick in the second half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}