{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"3b1f9675-08ab-5cc4-80ee-82de46410364","task_key":"default--validation--a1853589~2d7537~2d4624~2d8b31~2d85be423baf1e","task_revision_id":"2","upstream_id":"a1853589-7537-4624-8b31-85be423baf1e","short_description":"How many total points were scored by halftime?","config":"default","split":"validation","body":"{\"passage\":\" Coming off a bye week, the Bears battled rival Detroit Lions on Monday Night Football. The team kept the Lions from scoring until the fourth quarter, and forced four takeaways. The first turnover forced was in the first half, when Lance Briggs stripped the ball from Mikel Leshoure, which was recovered by Julius Peppers. The second and third turnovers were forced in the third quarter on Zack Bowman's muffed punt recovery, and Brian Urlacher recovering Joique Bell's fumble. The final turnover occurred when Lions quarterback Matthew Stafford's pass was intercepted by D. J. Moore. The Bears struck first on Jay Cutler's touchdown pass to Brandon Marshall, and Robbie Gould kicked a field goal to increase the first half score to 10-0. During the game, Lions defensive tackle Ndamukong Suh threw Cutler to the ground, injuring his ribs. Cutler was eventually replaced by Jason Campbell for a play, before returning to the game. In the second half, Gould kicked another field goal, and prevented the Lions from scoring until the final 36 seconds of the game, when Stafford threw a 12-yard touchdown pass to Ryan Broyles to narrow the margin to six points, but the Bears sealed the victory by recovering the ensuring onside kick.\",\"question\":\"How many total points were scored by halftime?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}