{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"13be305a-315a-5c89-8264-33c5a4d69d0d","task_key":"default--validation--6c3a79e9~2d5685~2d4a5d~2d8a15~2db28469e92116","task_revision_id":"1","upstream_id":"6c3a79e9-5685-4a5d-8a15-b28469e92116","short_description":"How many points did Atlanta lead by after the first quarter?","config":"default","split":"validation","body":"{\"passage\":\" Against the Atlanta Falcons, the Kansas City Chiefs were behind early in the first quarter when Falcons quarterback Matt Ryan threw an 8-yard touchdown pass to wide receiver Julio Jones to lead 7-0. The Chiefs answered with a 39-yard field goal from Ryan Succop to make it 7-3. The Falcons scored on their next drive with a 34-yard field goal from Matt Bryant to extend their lead 10-3. In the second quarter, Matt Cassel threw a 22-yard touchdown pass to tight end Kevin Boss to tie the game at 10-10. Matt Ryan and the Falcons took the lead again with a 14-yard touchdown pass to wide receiver Julio Jones to go up 17-10. Matt Cassel scored on a 5-yard rushing touchdown on the Chiefs next possession to make the score tied again at 17-17. The Falcons just managed to extend their lead before halftime with a 21-yard field goal by Matt Bryant to lead 20-17 coming into the half. In the third quarter, Matt Ryan scored on a 5-yard touchdown run to make it 27-17. Shortly afterward, Matt Ryan tossed a 7-yard touchdown pass to tight end Tony Gonzalez to further extend their lead 34-17. In the fourth quarter, the Atlanta falcons scored twice on field goals of 30 and 41 yards by Matt Bryant to lead 40-17. Late in the fourth quarter, the Chiefs scored on a 4-yard run by running back Shaun Draughn. The final score of this game is 24-40 as the Kansas City Chiefs fall to 0-1\",\"question\":\"How many points did Atlanta lead by after the first quarter?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}