{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4f1900c6-6319-5d36-8637-ce2710fb99e9","task_key":"default--validation--3585180e~2de0a1~2d4e44~2d864a~2d7be794ee2f01","task_revision_id":"1","upstream_id":"3585180e-e0a1-4e44-864a-7be794ee2f01","short_description":"How many times did the Browns score in the fourth quarter?","config":"default","split":"validation","body":"{\"passage\":\" The Steelers started their 2014 season at home against the Browns.  In the first quarter, the Steelers would score first when Shaun Suisham kicked a 36-yard field goal for a 3-0 lead.  However, the Browns were able to tie it up when Billy Cundiff kicked a 39-yard field goal for a 3-3 game.  The Steelers would score 24 unanswered points to end the first half with LaGarrette Blount running for a 7-yard TD to retake the lead 10-3.  In the 2nd quarter, the Steelers continued their domination when Ben Roethlisberger found Antonio Brown on a 35-yard TD for a 17-3 lead followed by Le'Veon Bell running in for a TD from 38 yards out to increase their lead to 24-3 followed by Suisham nailing yet another field goal from 34 yards out as they led 27-3 at halftime.  After the break, in the 3rd quarter, the Browns went to work as Isisah Crowell ran for 2 touchdowns:  from 3 and 15 yards out for a 27-10 and 27-17 game.  In the 4th quarter, the Browns managed to come within a TD as Cundiff nailed a 25-yard field goal for a 27-20 game.  Later on, Brian Hoyer hooked up with Travis Benjamein on a 9-yard TD pass to tie the game up 27-27.  Regardless, Roethlisberger was able to move his team down the field and eventually, Suisham kicked the game-winning 41-yard field goal to win it 30-27 for the Steelers' only 3 points of the 2nd half. With the win, the Steelers started their season 1-0 for the first time since 2010 and in turn handed the Browns their 10th straight regular season opening loss.\",\"question\":\"How many times did the Browns score in the fourth quarter?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}