{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d8d6982a-8352-5445-be2b-3456e0413a52","task_key":"default--validation--6ce9b33b~2db86e~2d4390~2d8d9d~2dc2e6e7b353fe","task_revision_id":"1","upstream_id":"6ce9b33b-b86e-4390-8d9d-c2e6e7b353fe","short_description":"Previous to 2005, when was the previous time the Wizards had won a playoff…","config":"default","split":"validation","body":"{\"passage\":\"With a 93-82 win over the Chicago Bulls on April 13, 2005, the Wizards clinched a playoff spot for the first time since 1996-97. Long-suffering fans celebrated by buying over 16,000 playoff tickets in two and a half hours the day tickets went on sale. In game 3 of the 2005 NBA Playoffs against the Bulls, the Wizards won their first playoff game since 1988. Adding to the \\\"long-overdue\\\" feeling was the fact that game 3 was the first NBA playoff game to be held within Washington, D.C. city limits. In the Wizards game 5 victory in Chicago, Arenas hit a buzzer-beater to win the game and the Wizards took their first lead in a playoff series since 1986. In Game 6 at the MCI Center, Jared Jeffries picked up a loose ball and went in for an uncontested tie-breaking dunk with 32 seconds left, thus giving the Wizards a 94-91 win and the teams first playoff series win in 23 years. They were only the 12th team in NBA history to win a playoff series after being down 0-2.\",\"question\":\"Previous to 2005, when was the previous time the Wizards had won a playoff series?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}