{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4f2c4e89-e295-5f0f-aed7-b287feb9128d","task_key":"default--validation--ba1a180b~2d569c~2d4a44~2daa13~2d6e3db6680178","task_revision_id":"1","upstream_id":"ba1a180b-569c-4a44-aa13-6e3db6680178","short_description":"Which team lost the game on November 5, 1989, the Timberwolves or Chicago Bulls?","config":"default","split":"validation","body":"{\"passage\":\"The Timberwolves debuted on November 3, 1989, losing to the Seattle SuperSonics on the road 106-94. Five days later, they made their home debut at the Hubert H. Humphrey Metrodome, losing to the Chicago Bulls 96-84. Two nights later on November 10, the Wolves got their first win, beating the Philadelphia 76ers at home 125-118. The Timberwolves, led by Tony Campbell with 23.2 ppg, went on to a 22-60 record, finishing in sixth place in the Midwest Division. Playing in the Hubert H. Humphrey Metrodome, the expansion Timberwolves set an NBA record by drawing over 1 million fans to their home games. This included a crowd of 49,551 on April 17, 1990, which saw the Timberwolves lose to the Denver Nuggets 99-88 in the final home game of the season.\",\"question\":\"Which team lost the game on November 5, 1989, the Timberwolves or Chicago Bulls?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}