{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b9e8ece-53b7-5aff-8288-3ada563972ab","task_key":"default--validation--dbfc9caa~2d6f6a~2d4eb4~2dbb06~2d8f019d711378","task_revision_id":"1","upstream_id":"dbfc9caa-6f6a-4eb4-bb06-8f019d711378","short_description":"How many points did the Packers win by?","config":"default","split":"validation","body":"{\"passage\":\" The Giants played their Week 2 home opener against the Green Bay Packers.  After both teams missed a field goal to open the game, Green Bay got on the board first with a 6-yard run by rookie DeShawn Wynn. The Giants responded with a 26-yard scoring strike by Eli Manning to Plaxico Burress. The Giants got a Lawrence Tynes field goal and a 10-7 half time lead. In the second half, the Packers drove 51 yards to start the second half. Favre capped off the scoring drive with a 2-yard pass to Bubba Franks for a 14-10 lead the Packers would not relinquish. The Giants responded with another drive but once again, an unsportsmanlike conduct penalty, this one on Amani Toomer, hurt the Giants. Tynes kicked a second field goal, pulling the Giants to within one. With the loss, the Giants would fall to 0-2 for the first time since 1996.\",\"question\":\"How many points did the Packers win by?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}