{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"013b2447-8715-5f60-a821-9e2f427bf4de","task_key":"default--validation--6423beb3~2d0fe4~2d433f~2d89d8~2de6df530cc38e","task_revision_id":"1","upstream_id":"6423beb3-0fe4-433f-89d8-e6df530cc38e","short_description":"How many point were scored in total?","config":"default","split":"validation","body":"{\"passage\":\" This would be the first meeting between quarterbacks Russell Wilson and Andrew Luck, who were both selected in the 2012 NFL Draft. Though Wilson and the Seahawks maintained a lead throughout the first three quarters, Luck led the Colts back, taking the lead and never letting go in the 4th. It would be the first loss for the Seahawks in the season, dropping their record to 4-1. The Colts punted and the Seahawks drove down the field and scored a field goal to go up 3-0. After another Indy three-and-out, Russell Wilson threw a 10-yard touchdown pass to Golden Tate to take a 10-0 lead. Then another Indy punt was blocked and bounced out of the endzone to extend the lead to 12-0. Seattle punted to Indy when Andrew Luck threw a 73-yard touchdown to T.Y. Hilton to make the score 12-7. Seattle drove into field goal range but a 48-yard field goal was blocked and returned for a touchdown by the Colts. Indy led 14-12 until Wilson found Jermaine Kearse to give Seattle a 19-14 lead. Luck led the Colts downfield and they kicked a field goal to make it 19-17 at the half. Seattle kicked another field goal to make it 22-17. Indianapolis fumbled and led to a 25-17 Seahawks lead. Luck then found Hilton in the endzone but the two-point-conversion failed leaving  the score at 25-23. Seattle then kicked a 4th field goal to extend their lead to 28-23. Indy scored a touchdown to make it 31-28 and then a field goal to make it 34-28 final.\",\"question\":\"How many point were scored in total?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}