{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"317a7a34-866f-5a46-9181-5eb93979bb9d","task_key":"default--validation--7b27e940~2d046f~2d43d2~2da54f~2d797282273faf","task_revision_id":"1","upstream_id":"7b27e940-046f-43d2-a54f-797282273faf","short_description":"How many more touchdowns did Jonathan Stewart get compared to Adrian Peterson?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their home win over the Bengals, the Vikings flew to Bank of America Stadium to face the Carolina Panthers in a Week 15 Sunday Night duel. The Vikings clinched the NFC North about an hour before the game thanks in part to Pittsburgh's 37-36 last-second win over the Packers. With a win, the Vikings would be one game behind New Orleans to clinch homefield advantage. After a scoreless first quarter, Carolina got on the board with quarterback Matt Moore finding fullback Brad Hoover on a 1-yard TD pass. The extra point attempt was blocked, however. The Vikings then took the lead later in the quarter with running back Adrian Peterson's 4-yard TD run. After yet another scoreless quarter, it was all Carolina as Matt Moore completed a 42-yard TD pass to wide receiver Steve Smith, as well as running back Jonathan Stewart running in a 3-yard TD, as well as catching a 2-yard TD pass from Moore. With the loss, the Vikings fell to 11-3. Reports surfaced after the game suggesting that there was tension between Vikings quarterback Brett Favre and head coach Brad Childress. The incident was later resolved.\",\"question\":\"How many more touchdowns did Jonathan Stewart get compared to Adrian Peterson?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}