{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"930a6dab-b1b4-509f-a14d-372c98c140c5","task_key":"default--validation--d55fe6ce~2d2eb9~2d4440~2db714~2d6a81f51a9309","task_revision_id":"1","upstream_id":"d55fe6ce-2eb9-4440-b714-6a81f51a9309","short_description":"Which players all completed a single touchdown during the game?","config":"default","split":"validation","body":"{\"passage\":\"Stabler finished the game with 12 out of 19 pass completions for 180 yards and 1 touchdown. Davis, who was the top rusher in the game, gained 137 yards on just 16 rushing attempts, an average of 8.5 yards per carry. Of Davis 16 carries, 11 were runs to the left side, which is where the blocking of guard Gene Upshaw, tackle Art Shell and Casper dominated defensive end Jim Marshall (gridiron football) and linebacker Wally Hilgenberg. Marshall made no tackles in the game and Hilgenberg made only two. Casper finished the game with 4 receptions for 70 yards and 1 touchdown. Colzie returned 4 punts for a Super Bowl record 43 yards. Foreman had a solid performance for Minnesota, contributing 44 rushing yards and 62 receiving yards. Tarkenton completed 17 out of 35 pass attempts for 205 yards, 1 touchdown, and 2 interceptions. White recorded 163 total yards, catching 5 passes for 77 yards and 1 touchdown, rushing once for 7 yards, and returning 4 kickoffs for 79 yards. The Raiders won their first Super Bowl and according to Brown, winning Super Bowl XI \\\"made up for the other Raiders who came before and didn’t have a chance to participate on a winning Super Bowl team. This victory meant not only a lot to me, it meant a lot to the entire Raider organization.\\\"  The win was particularly satisfying for Brown, who scored a Super Bowl touchdown and earned his first championship ring after 14 years of professional football.\",\"question\":\"Which players all completed a single touchdown during the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}