{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c10fac0-53e6-5ca6-8463-42b31302a6ab","task_key":"default--validation--f8fee689~2d8978~2d43c0~2d98cd~2d6d8897a6d828","task_revision_id":"1","upstream_id":"f8fee689-8978-43c0-98cd-6d8897a6d828","short_description":"How many points did Atlanta win by?","config":"default","split":"validation","body":"{\"passage\":\" Against the Atlanta Falcons, the Kansas City Chiefs were behind early in the first quarter when Falcons quarterback Matt Ryan threw an 8-yard touchdown pass to wide receiver Julio Jones to lead 7-0. The Chiefs answered with a 39-yard field goal from Ryan Succop to make it 7-3. The Falcons scored on their next drive with a 34-yard field goal from Matt Bryant to extend their lead 10-3. In the second quarter, Matt Cassel threw a 22-yard touchdown pass to tight end Kevin Boss to tie the game at 10-10. Matt Ryan and the Falcons took the lead again with a 14-yard touchdown pass to wide receiver Julio Jones to go up 17-10. Matt Cassel scored on a 5-yard rushing touchdown on the Chiefs next possession to make the score tied again at 17-17. The Falcons just managed to extend their lead before halftime with a 21-yard field goal by Matt Bryant to lead 20-17 coming into the half. In the third quarter, Matt Ryan scored on a 5-yard touchdown run to make it 27-17. Shortly afterward, Matt Ryan tossed a 7-yard touchdown pass to tight end Tony Gonzalez to further extend their lead 34-17. In the fourth quarter, the Atlanta falcons scored twice on field goals of 30 and 41 yards by Matt Bryant to lead 40-17. Late in the fourth quarter, the Chiefs scored on a 4-yard run by running back Shaun Draughn. The final score of this game is 24-40 as the Kansas City Chiefs fall to 0-1\",\"question\":\"How many points did Atlanta win by?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}