{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65e11d61-8630-5159-abe1-705089ee92c7","task_key":"default--validation--63f6ffb1~2d49dd~2d4790~2dacb8~2d89fe05f8cdde","task_revision_id":"1","upstream_id":"63f6ffb1-49dd-4790-acb8-89fe05f8cdde","short_description":"Which team scored the most points?","config":"default","split":"validation","body":"{\"passage\":\" In cold and windy conditions, Brett Favre threw 2 interceptions, and the Bears blocked 2 punts, en route to a 35-7 victory over the Packers, giving the Bears a sweep against Green Bay for the 2007 season. The Packers had not had a punt blocked in 12 years (929 punts). The last time the Packers had 2 punts blocked in a game was September 21, 1975, in a game against Detroit. Favre ended the game with 158 passing yards, and he surpassed 4,000 yards passing for the season, the 5th time in his career to achieve the mark.  Ryan Grant ran for 100 total yards and the only touchdown for the Packers. With the loss, the Packers fell to 12-3 on the season.\",\"question\":\"Which team scored the most points?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}