{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8230077b-14b1-5c0c-9867-5fd865b8f043","task_key":"default--validation--7a85860d~2d53ae~2d4572~2d9504~2de4e1a47406d1","task_revision_id":"1","upstream_id":"7a85860d-53ae-4572-9504-e4e1a47406d1","short_description":"How many field goals were made in the game?","config":"default","split":"validation","body":"{\"passage\":\" The Browns hosted the rival Pittsburgh Steelers on a night with subzero wind chills for a Week 14 duel. In windy conditions, Phil Dawson hit a pair of 29-yard field goals, and Chris Jennings had a 10-yard touchdown run to put the Browns up 13. Jeff Reed nailed a field goal before the half to draw the Steelers within 10, and hit another in the third to bring them within a touchdown. However, a scoreless fourth by both teams led the Browns to their first win against the Steelers since 2003, and the Browns became only the fourth team in NFL history to be at least 10 games under .500 and defeat the defending Super Bowl champions. With the win, the Browns improved to 2-11, snapped a twelve-game losing streak against the Steelers and won against them for the first time since 2003 when they defeated the team 33-13 in Pittsburgh.  The team also won their first home game since an October 2008 victory, interestingly against then-defending Super Bowl champion New York Giants. KR Josh Cribbs was named AFC Special Teams Player of the Week.\",\"question\":\"How many field goals were made in the game?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}