{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"003a1275-1afc-5342-95d0-94f2181493e9","task_key":"default--validation--fb4f123b~2d22ea~2d4984~2d8027~2db460a192e16a","task_revision_id":"1","upstream_id":"fb4f123b-22ea-4984-8027-b460a192e16a","short_description":"How many field goals did Jason Hanson score?","config":"default","split":"validation","body":"{\"passage\":\" In week 9, the Lions flew south to play the Jacksonville Jaguars. After a scoreless first quarter, the Lions' Mikel Leshoure ran in three consecutive touchdowns, from 7, 1, and 8 yards out respectively to take a 21-point lead going into halftime. Leshoure became the first Lions rusher to score three touchdowns in the first half. After a scoreless third quarter, Detroit's Jason Hanson kicked a 42-yard field goal. The Jaguars finally got on the board when Micheal Spurlock caught a 5-yard touchdown pass from Blaine Gabbert; they then completed a two-point conversion when Blaine Gabbert completed a pass to Rashad Jennings. The Lions responded with a 10-yard touchdown run from Joique Bell. Jacksonville scored the final points of the game with a 6-yard touchdown catch from Blaine Gabbert to Justin Blackmon; they again went for a two-point conversion, but were unsuccessful this time. It was the Lions' most lopsided win of the season and would also be their final victory of the 2012 season.\",\"question\":\"How many field goals did Jason Hanson score?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}