{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7b24e6ca-31b0-59f6-9599-39b0c50d7956","task_key":"default--validation--64bb1a13~2da9ad~2d403e~2d9c88~2d5498ddd81086","task_revision_id":"1","upstream_id":"64bb1a13-a9ad-403e-9c88-5498ddd81086","short_description":"How many field goals were kicked in the first half?","config":"default","split":"validation","body":"{\"passage\":\" Willie Parker missed his fourth game due to a knee injury. Santonio Holmes also missed the game after a \\\"small quantity of marijuana\\\" was found in his car and the team placed him on the inactive list. Mewelde Moore opened up the game's scoring with a 32-yard touchdown run on the Steelers opening drive. The 5-1 New York Giants responded with a field goal on the ensuing drive. Pittsburgh stopped the Giants on four consecutive plays from inside the Steelers 2-yard line to force a turnover on downs. But were unable to score when two Ben Roethlisberger interceptions and a punt lead to two more field goals in the second quarter for the Giants. At 10:10 of the third quarter Roethlisberger completed a 65-yard touchdown pass to Nate Washington to give the Steelers a 14-9 lead. Later in the quarter, a Steelers 53-yard touchdown pass was negated due to a holding penalty and Pittsburgh was forced to punt. In the final quarter Pittsburgh kept New York out of the end zone on three plays inside the 10-yard line, however, the Giants connected on a field goal to bring the Giants to within two points. On the next drive, James Harrison—who was called in to replace injured long snapper Greg Warren—snapped the ball out of the end zone to give the Giants a safety and tie the game. The Giants drove after receiving the safety's kickoff to score a touchdown—taking a 21-14 lead with 3:07 remaining. Pittsburgh was unable to convert on their final two drives, as Roethlisberger threw his fourth interception of the day.\",\"question\":\"How many field goals were kicked in the first half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}