{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92af3b67-3b8e-5412-b12e-ac404665fe61","task_key":"default--validation--60294197~2d781f~2d4514~2d89db~2d655e423c8ae0","task_revision_id":"1","upstream_id":"60294197-781f-4514-89db-655e423c8ae0","short_description":"What year did the Cats get their first of three consecutive championship…","config":"default","split":"validation","body":"{\"passage\":\"On September 8, 2007, the Cats defeated the St. Paul Saints 4-1 in the fifth game of the American Association Championship playoffs to capture a second straight American Association Championship and third straight overall. The Cats had won 6 straight decisive Game 5s and were 13-0 in games in which they faced elimination the last 3 seasons. They had been down 2 games to 1 in 5 of the last 6 series following a pattern of winning the first game, losing the next two, and then winning games 4 and 5. The only exception was when they were down 2-0 to the El Paso Diablos in the 2007 Division Series before winning 3 straight at LaGrave Field. The 2007 regular season record was 53-40 with a 0.570 winning percentage. Total season attendance was 141,330 for 34 games, which was an average of 4,157 per game. Max Scherzer was on the Cats roster in 2007. In 2008, he was called up to the Arizona Diamondbacks.\",\"question\":\"What year did the Cats get their first of three consecutive championship overall?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}