{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd570e35-2b29-5ad0-98af-6bbd5d288f32","task_key":"default--validation--84b22999~2d6699~2d4c8d~2d9f5d~2d52be4213ff85","task_revision_id":"1","upstream_id":"84b22999-6699-4c8d-9f5d-52be4213ff85","short_description":"How many touchdown runs did the Vikings have?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their home win over the Bengals, the Vikings flew to Bank of America Stadium to face the Carolina Panthers in a Week 15 Sunday Night duel. The Vikings clinched the NFC North about an hour before the game thanks in part to Pittsburgh's 37-36 last-second win over the Packers. With a win, the Vikings would be one game behind New Orleans to clinch homefield advantage. After a scoreless first quarter, Carolina got on the board with quarterback Matt Moore finding fullback Brad Hoover on a 1-yard TD pass. The extra point attempt was blocked, however. The Vikings then took the lead later in the quarter with running back Adrian Peterson's 4-yard TD run. After yet another scoreless quarter, it was all Carolina as Matt Moore completed a 42-yard TD pass to wide receiver Steve Smith, as well as running back Jonathan Stewart running in a 3-yard TD, as well as catching a 2-yard TD pass from Moore. With the loss, the Vikings fell to 11-3. Reports surfaced after the game suggesting that there was tension between Vikings quarterback Brett Favre and head coach Brad Childress. The incident was later resolved.\",\"question\":\"How many touchdown runs  did the Vikings have?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}