{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c7d37a7c-78a8-5e4b-add4-a29ad8a07f54","task_key":"default--validation--80e94a38~2de2e3~2d46d4~2d94ef~2d7a3d3e3f2f45","task_revision_id":"1","upstream_id":"80e94a38-e2e3-46d4-94ef-7a3d3e3f2f45","short_description":"Which player had the first rushing touchdown?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their home win over the Bengals, the Vikings flew to Bank of America Stadium to face the Carolina Panthers in a Week 15 Sunday Night duel. The Vikings clinched the NFC North about an hour before the game thanks in part to Pittsburgh's 37-36 last-second win over the Packers. With a win, the Vikings would be one game behind New Orleans to clinch homefield advantage. After a scoreless first quarter, Carolina got on the board with quarterback Matt Moore finding fullback Brad Hoover on a 1-yard TD pass. The extra point attempt was blocked, however. The Vikings then took the lead later in the quarter with running back Adrian Peterson's 4-yard TD run. After yet another scoreless quarter, it was all Carolina as Matt Moore completed a 42-yard TD pass to wide receiver Steve Smith, as well as running back Jonathan Stewart running in a 3-yard TD, as well as catching a 2-yard TD pass from Moore. With the loss, the Vikings fell to 11-3. Reports surfaced after the game suggesting that there was tension between Vikings quarterback Brett Favre and head coach Brad Childress. The incident was later resolved.\",\"question\":\"Which player had the first rushing touchdown?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}