{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d1ab8e92-2d45-5217-b262-3a44192790fb","task_key":"default--validation--a2cc06da~2df96f~2d4a78~2da7e4~2d59e5634e4d42","task_revision_id":"1","upstream_id":"a2cc06da-f96f-4a78-a7e4-59e5634e4d42","short_description":"How many more wins did the Hawks have compared to losses?","config":"default","split":"validation","body":"{\"passage\":\"On January 31, 2015, the Hawks became the first NBA team to go 17–0 in a calendar month by beating Portland. The 2015 All-Star Game consisted of four Hawks All-Stars including Jeff Teague, Paul Millsap, Kyle Korver and Al Horford. On March 9, 2015, Kyle Korver and DeMarre Carroll each scored 20 points to help the Hawks become the first NBA team to 50 wins in 2014–15, scoring a season-high in routing the Sacramento Kings 130-105. The Hawks also set a franchise record by going 20-of-36 for three-pointers, breaking the mark of 19 set against the Dallas Mavericks on December 17, 1996. On March 20, 2015, the Hawks clinched their first division title in over two decades and became the first team not based in Florida to win the NBAs Southeast Division (NBA); one week later, with a win over Miami as well as a Cleveland loss to Brooklyn, the Hawks clinched the top seed in the 2015 NBA Playoffs. The team finished a franchise-best 60-22.\",\"question\":\"How many more wins did the Hawks have compared to losses?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}