{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d8c3ae8b-5dd3-5290-bcc8-8aa571236d77","task_key":"default--validation--66c679a9~2deb1f~2d4534~2da30f~2d2f3357d31fe0","task_revision_id":"1","upstream_id":"66c679a9-eb1f-4534-a30f-2f3357d31fe0","short_description":"How many passes did Matthew Stafford not complete?","config":"default","split":"validation","body":"{\"passage\":\" For their home opener, the Lions hosted the Kansas City Chiefs. The Lions scored first when Calvin Johnson caught a 15-yard pass for a touchdown. Kansas City then scored their only points of the game with a 33-yard field goal by Ryan Succop. In the second quarter, the Lions' Tony Scheffler caught a 36-yard pass for a touchdown. They added to their lead with two field goals from Jason Hanson, from 51 and 28 yards respectively. After halftime, the Lions scored four consecutive touchdowns, three of which followed Kansas City turnovers. First, Calvin Johnson scored on a 1-yard catch. Afterward, Jahvid Best scored two consecutive touchdowns in the fourth quarter, first with a 9-yard catch, and later on a 1-yard run. The Lions capped their blowout victory with a 1-yard run by Keiland Williams.  The blowout win set the franchise record for largest margin of victory. It was the first time the Lions went 2-0 since 2007. Lions QB Matthew Stafford - who completed 23 of 39 passes, threw for 294 yards and 4 touchdowns - won the FedEx Air NFL Player of the Week for his performance.\",\"question\":\"How many passes did Matthew Stafford not complete?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}