{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"edf13560-73a2-56da-8990-dca92699c717","task_key":"default--validation--d6db8c54~2d4d06~2d46aa~2db07a~2dfed42863a63d","task_revision_id":"1","upstream_id":"d6db8c54-4d06-46aa-b07a-fed42863a63d","short_description":"How many points did the Lions score in the first half?","config":"default","split":"validation","body":"{\"passage\":\" For their annual Thanksgiving Day game, the Lions hosted a rematch with their divisional rival, the Minnesota Vikings. The Vikings scored 13 points in the first quarter via a one-yard touchdown pass from Case Keenum to Kyle Rudolph, and a nine-yard touchdown run from Keenum. The Lions responded with 10 points in the second quarter via a 32-yard field goal from Matt Prater and a six-yard touchdown pass from Matthew Stafford to Marvin Jones Jr. The Vikings extended their lead in the second quarter via a 22-yard touchdown pass from Keenum to Rudolph to make the score 20-10 in favor of Minnesota at half-time. The Vikings opened the scoring in the second half via a two-yard touchdown run from Latavius Murray. The Lions responded with two field goals from Prater in the third quarter from 32-yards, and 50-yards, respectively. The Lions reduced the Vikings lead to four points in the fourth via a 43-yard touchdown pass from Stafford to Jones. The Vikings extended their lead in the fourth quarter via a 36-yard field goal from Kai Forbath. The Lions' attempted comeback failed when Stafford's pass intended for Jones was intercepted by Xavier Rhodes. On the Vikings' ensuing drive, Forbath's 25-yard field goal attempt was blocked by Darius Slay and recovered by Nevin Lawson and returned for a 77-yard touchdown, which was then nullified due to an offside penalty on Slay, making the final score 30-23 in favor of Minnesota, snapping the Lions' three-game winning streak.\",\"question\":\"How many points did the Lions score in the first half?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}