{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50423d40-59e7-54e5-9825-f1f8bc22020c","task_key":"default--validation--b6bc4ad8~2d1d5b~2d4b0d~2db5d8~2def41347b9b7a","task_revision_id":"1","upstream_id":"b6bc4ad8-1d5b-4b0d-b5d8-ef41347b9b7a","short_description":"How many scoring yards did Jonathan Stewart have?","config":"default","split":"validation","body":"{\"passage\":\" Coming off their home win over the Bengals, the Vikings flew to Bank of America Stadium to face the Carolina Panthers in a Week 15 Sunday Night duel. The Vikings clinched the NFC North about an hour before the game thanks in part to Pittsburgh's 37-36 last-second win over the Packers. With a win, the Vikings would be one game behind New Orleans to clinch homefield advantage. After a scoreless first quarter, Carolina got on the board with quarterback Matt Moore finding fullback Brad Hoover on a 1-yard TD pass. The extra point attempt was blocked, however. The Vikings then took the lead later in the quarter with running back Adrian Peterson's 4-yard TD run. After yet another scoreless quarter, it was all Carolina as Matt Moore completed a 42-yard TD pass to wide receiver Steve Smith, as well as running back Jonathan Stewart running in a 3-yard TD, as well as catching a 2-yard TD pass from Moore. With the loss, the Vikings fell to 11-3. Reports surfaced after the game suggesting that there was tension between Vikings quarterback Brett Favre and head coach Brad Childress. The incident was later resolved.\",\"question\":\"How many scoring yards did Jonathan Stewart have?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}