{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a957615-b610-5804-887c-3ba170665b30","task_key":"default--validation--07c58f6c~2d9271~2d4b1a~2d9d7f~2d4c11bdfcec33","task_revision_id":"1","upstream_id":"07c58f6c-9271-4b1a-9d7f-4c11bdfcec33","short_description":"Who had a higher yards per catch average, Rice or John Taylor?","config":"default","split":"validation","body":"{\"passage\":\"Montana finished the regular season with 238 completions for 2,981 yards and 18 touchdowns, and also added 132 rushing yards. His favorite target was Rice, who recorded 64 receptions for 1,306 yards (a 20.4 yards per catch average) and 9 touchdowns. Craig was also a key contributor, leading the team in receptions (76) while finishing the season with a total of 2,036 combined rushing and receiving yards and 10 touchdowns, earning him the NFL Offensive Player of the Year Award. Fullback Tom Rathman also made a big impact, rushing for 427 yards and catching 42 passes for 387 yards.  San Francisco also had a major special teams threat in second-year receiver John Taylor (American football), who led the NFL in punt return yards (556), yards per return, (12.6), and touchdowns (2).  He also gained 228 yards on kickoff returns and 325 receiving yards on just 14 receptions (a 23.2 yards per catch average).\",\"question\":\"Who had a higher yards per catch average, Rice or John Taylor?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}