{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7e83d8ae-f2bb-53b3-bba0-6de2a77f3a8c","task_key":"default--validation--1b6c1d12~2d83fd~2d48e4~2da653~2da30a728a9c77","task_revision_id":"1","upstream_id":"1b6c1d12-83fd-48e4-a653-a30a728a9c77","short_description":"How many yards shorter was Carson Palmer's second touchdown pass compared to his…","config":"default","split":"validation","body":"{\"passage\":\" Hoping to rebound from their loss to the Texans, the Bengals stayed at home for a Week 7 inter conference duel with the Chicago Bears.  In the first quarter, Cincinnati got off to a fast start as quarterback Carson Palmer completed a 9-yard touchdown pass to wide receiver Chris Henry and an 8-yard touchdown pass to wide receiver Chad Ochocinco.  The Bengals would continue their dominating day in the second quarter as Palmer found tight end J.P. Foschi on a 3-yard touchdown pass and wide receiver Laveranues Coles on an 8-yard touchdown pass, followed by kicker Shayne Graham booting a 29-yard field goal.  The Bears would close out the half with a 22-yard field goal from kicker Robbie Gould. Afterwards, Cincinnati would pull away Palmer finding Ochocinco again on a 13-yard touchdown pass in the third quarter, followed by former Chicago running back Cedric Benson's 1-yard touchdown run.  The Bears would then end the game with quarterback Jay Cutler hooking up with wide receiver Devin Hester on a 5-yard touchdown pass. With the win, the Bengals went into their bye week at 5-2. And also surpassed their win total from last season\",\"question\":\"How many yards shorter was Carson Palmer's second touchdown pass compared to his first?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}