{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6cd52c25-dcd4-5822-87d6-e69fdd499cd3","task_key":"default--validation--20e6df96~2da8a0~2d4d38~2d9d6c~2d3507493d9d81","task_revision_id":"1","upstream_id":"20e6df96-a8a0-4d38-9d6c-3507493d9d81","short_description":"How many points in total were scored?","config":"default","split":"validation","body":"{\"passage\":\" The Steelers started their 2014 season at home against the Browns.  In the first quarter, the Steelers would score first when Shaun Suisham kicked a 36-yard field goal for a 3-0 lead.  However, the Browns were able to tie it up when Billy Cundiff kicked a 39-yard field goal for a 3-3 game.  The Steelers would score 24 unanswered points to end the first half with LaGarrette Blount running for a 7-yard TD to retake the lead 10-3.  In the 2nd quarter, the Steelers continued their domination when Ben Roethlisberger found Antonio Brown on a 35-yard TD for a 17-3 lead followed by Le'Veon Bell running in for a TD from 38 yards out to increase their lead to 24-3 followed by Suisham nailing yet another field goal from 34 yards out as they led 27-3 at halftime.  After the break, in the 3rd quarter, the Browns went to work as Isisah Crowell ran for 2 touchdowns:  from 3 and 15 yards out for a 27-10 and 27-17 game.  In the 4th quarter, the Browns managed to come within a TD as Cundiff nailed a 25-yard field goal for a 27-20 game.  Later on, Brian Hoyer hooked up with Travis Benjamein on a 9-yard TD pass to tie the game up 27-27.  Regardless, Roethlisberger was able to move his team down the field and eventually, Suisham kicked the game-winning 41-yard field goal to win it 30-27 for the Steelers' only 3 points of the 2nd half. With the win, the Steelers started their season 1-0 for the first time since 2010 and in turn handed the Browns their 10th straight regular season opening loss.\",\"question\":\"How many points in total were scored?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}