{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b2d32c6-bc7b-5ce4-8c7c-ae5a2fd9b286","task_key":"default--validation--3d54e630~2d9fa9~2d4a7d~2da01c~2d2dfc9fe7b3d1","task_revision_id":"1","upstream_id":"3d54e630-9fa9-4a7d-a01c-2dfc9fe7b3d1","short_description":"Which team kicked a longer field goal in the fourth quarter?","config":"default","split":"validation","body":"{\"passage\":\" The Titans began their season at Heinz Field for the annual kickoff game against the defending Super Bowl champions, the Pittsburgh Steelers.  After a scoreless first quarter, Tennessee trailed near the end of the second quarter as Steelers quarterback Ben Roethlisberger completed a 34-yard touchdown pass to wide receiver Santonio Holmes.  Afterwards, the Titans would tie the game as quarterback Kerry Collins completed a 16-yard touchdown pass to wide receiver Justin Gage. After a scoreless third quarter, Tennessee took the lead as kicker Rob Bironas got a 45-yard field goal, while Pittsburgh kicker Jeff Reed made a 32-yard field goal to tie the game.  In overtime, the Steelers got the win as Reed nailed a game-winning 33-yard field goal. With the loss, the Titans started the season out at 0-1.\",\"question\":\"Which team kicked a longer field goal in the fourth quarter?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}