{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4250b6f4-4633-5f67-af09-8d012e0cfe63","task_key":"default--validation--e785f46d~2dbe01~2d4812~2d9081~2ddc4385fb3966","task_revision_id":"1","upstream_id":"e785f46d-be01-4812-9081-dc4385fb3966","short_description":"How many more yards of total field goals did Rian Lindell make than Josh Scobee?","config":"default","split":"validation","body":"{\"passage\":\" Hoping to rebound from their loss to the Titans, the Bills flew to Jacksonville Municipal Stadium for an intraconference duel with the Jacksonville Jaguars. In the 1st quarter Buffalo trailed early as kicker Josh Scobee made a 29-yard field goal. Then the Bills came on top with kicker Rian Lindell hitting a 26 and a 28-yard field goal. The Bills fell behind in the 2nd quarter when RB Maurice Jones-Drew got a 3-yard touchdown run. Then the Bills would score to end the half with Lindell nailing a 22-yard field goal. In the third quarter Buffalo took the lead with QB Ryan Fitzpatrick making a 98-yard touchdown pass to WR Terrell Owens (with a failed 2-point conversion attempt). In the fourth quarter Buffalo fell behind again with QB David Garrard making a 3-yard touchdown pass to WR Mike Sims-Walker (With a successful QB sneak to make the two-point conversion). With the loss, the Bills fell to 3-7 in Perry Fewell's first game as interim head coach.\",\"question\":\"How many more yards of total field goals did Rian Lindell make than Josh Scobee?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}