{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"af16ba76-739f-5af9-befb-956fc2fac988","task_key":"default--validation--a1b87dd0~2dc456~2d4d20~2db1e1~2d4e8e7cff89eb","task_revision_id":"1","upstream_id":"a1b87dd0-c456-4d20-b1e1-4e8e7cff89eb","short_description":"How many losses did the cowboys have against the giants?","config":"default","split":"validation","body":"{\"passage\":\" Following their second loss to the Giants, the Cowboys returned to Arlington in a match against the Tampa Bay Buccaneers (who were coming off a five-game winning streak). Despite both teams sharing the lead from time and time again, the Cowboys were able to hold off the Buccaneers. With less than a minute remaining in the fourth quarter, Orlando Scandrick intercepted a pass from Buccaneers quarterback Jameis Winston (who fumbled earlier in the first half) and ended the game as a Cowboys victory. Dallas' only other highlight came early in the second quarter when Ezekiel Elliott leapt onto the Salvation Army kettle after scoring a touchdown to lead Dallas 10-3. This celebration resulted in a 15-yard unsportsmanlike conduct penalty; however, the following day, the NFL decided to not fine Elliott for the celebration. The Cowboys improved to 12-2, and with the Giants' loss to the Eagles the following Thursday night, they clinched the NFC East title and home field advantage throughout the playoffs.\",\"question\":\"How many losses did the cowboys have against the giants?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}