{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"012789ae-6588-5068-8b03-53f794b0de9f","task_key":"default--validation--df8725ca~2dc36d~2d4286~2dbe25~2d4c55dcfcfb03","task_revision_id":"1","upstream_id":"df8725ca-c36d-4286-be25-4c55dcfcfb03","short_description":"How many field goals were kicked in the first half?","config":"default","split":"validation","body":"{\"passage\":\" Coming off an easy win over the 49ers, the Seahawks flew to INVESCO Field at Mile High for an interconference duel with their former division rival, the Broncos. In the first quarter Seattle trailed early as QB Kyle Orton made a 13-yard TD pass to WR Eddie Royal, followed in the second quarter by RB Correll Buckhalter getting a 1-yard TD run. Then kicker Matt Prater made a 20-yard field goal to put the Broncos up 17-0. In the third quarter Seattle tried to cut the lead when QB Matt Hasselbeck completed an 11-yard TD pass to WR Ben Obomanu, but Denver scored with RB Knowshon Moreno getting a 1-yard TD run. In the fourth quarter Seattle fell further behind when Orton found WR Demaryius Thomas on a 21-yard TD pass. Seattle would make the final score of the game when Hasselbeck scrambled 20 yards to the endzone for a touchdown.\",\"question\":\"How many field goals were kicked in the first half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}