{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9eb2ef5c-2b5a-57c3-a351-5748be79e68f","task_key":"default--validation--d68e8475~2d0b97~2d43aa~2da155~2d4bfbd1f31146","task_revision_id":"1","upstream_id":"d68e8475-0b97-43aa-a155-4bfbd1f31146","short_description":"By how many points did the Wizards win against the Chicago Bulls on April 13,…","config":"default","split":"validation","body":"{\"passage\":\"With a 93-82 win over the Chicago Bulls on April 13, 2005, the Wizards clinched a playoff spot for the first time since 1996-97. Long-suffering fans celebrated by buying over 16,000 playoff tickets in two and a half hours the day tickets went on sale. In game 3 of the 2005 NBA Playoffs against the Bulls, the Wizards won their first playoff game since 1988. Adding to the \\\"long-overdue\\\" feeling was the fact that game 3 was the first NBA playoff game to be held within Washington, D.C. city limits. In the Wizards game 5 victory in Chicago, Arenas hit a buzzer-beater to win the game and the Wizards took their first lead in a playoff series since 1986. In Game 6 at the MCI Center, Jared Jeffries picked up a loose ball and went in for an uncontested tie-breaking dunk with 32 seconds left, thus giving the Wizards a 94-91 win and the teams first playoff series win in 23 years. They were only the 12th team in NBA history to win a playoff series after being down 0-2.\",\"question\":\"By how many points did the Wizards win against the Chicago Bulls on April 13, 2005?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}