{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0cc95f4-3bb4-5bc1-92c1-91d962b6af71","task_key":"default--validation--68812832~2d36ad~2d451b~2d9bd7~2dd987e6c84ad7","task_revision_id":"1","upstream_id":"68812832-36ad-451b-9bd7-d987e6c84ad7","short_description":"Which team was trailing in the fourth quarter?","config":"default","split":"validation","body":"{\"passage\":\" Playing on Sunday night for the first time all season, the Giants could not take advantage of three Vince Young interceptions and fumbled on their final drive, allowing the Eagles to salvage a split in the season series. New York fell behind 10-0 on an Alex Henery field goal and a touchdown pass from Young to former Giant Steve Smith. Trailing 10-3 entering the fourth, Eli Manning sought out Victor Cruz who caught a pass for 24 yards and the tying touchdown. However, they allowed Young to put together an 18-play drive finishing with a Riley Cooper touchdown pass. The Giants got the ball and Manning completed a pass to Cruz for 47 yards. The next play, Manning was stripped of the ball, sealing the Eagles victory. Despite his three interceptions Young threw for 258 yards in his relief effort for the injured Michael Vick. Manning threw for 264 yards, 128 of which went to Cruz. LeSean McCoy again rushed for 100 yards, recording 113 on 23 carries.\",\"question\":\"Which team was trailing in the fourth quarter?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}