{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c7d8aba3-84d2-5649-8f4a-10d025bf8ec4","task_key":"default--validation--a9fe26a4~2df75d~2d45e1~2da4b6~2d826ea466afa6","task_revision_id":"1","upstream_id":"a9fe26a4-f75d-45e1-a4b6-826ea466afa6","short_description":"How many receiving yards did Antonio Freeman, Robert Brooks, and William…","config":"default","split":"validation","body":"{\"passage\":\"Quarterback Brett Favre had another Pro Bowl season and became the first player ever to win the National Football League Most Valuable Player Award award three times, winning it for the third consecutive year (Favre was named co-MVP in 1997 with Detroit Lions running back Barry Sanders). Favre led the league with 35 passing touchdowns and completed 304 out of 513 attempts for 3,867 yards, with 16 interceptions, while ranking second on the team in rushing with 187 yards and a touchdown. Wide receiver Antonio Freeman led the team in receptions with 81 catches for 1,243 yards and 12 touchdowns. Wide receiver Robert Brooks was also a major deep threat, catching 60 passes for 1,010 yards and 7 touchdowns. Pro Bowl tight end Mark Chmura recorded 38 receptions for 417 yards and 6 touchdowns. Pro Bowl running back Dorsey Levens led the team in rushing with 1,435 yards and 7 touchdowns, while also catching 53 passes for 373 yards and 5 touchdowns. Fullback William Henderson (American football) rushed for 113 yards and caught 41 passes for 367 yards and a touchdown.\",\"question\":\"How many receiving yards did Antonio Freeman, Robert Brooks, and William Henderson have combined?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}