{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7d88ee0a-2355-5329-9d83-d3af6d9f0ab4","task_key":"default--validation--216af2cd~2df5bd~2d4fc2~2d9d6e~2d245f1e9b82cb","task_revision_id":"1","upstream_id":"216af2cd-f5bd-4fc2-9d6e-245f1e9b82cb","short_description":"How many points did Aberdeen have for the 2017 season?","config":"default","split":"validation","body":"{\"passage\":\"On 20 May 2016, Brendan Rodgers was announced as Deilas successor. Despite a Lincoln Red Imps 1-0 Celtic, his first season saw the team go on a long unbeaten run in domestic competitions, during which time the club won their 100th major trophy, defeating Aberdeen F.C. 3-0 in the League Cup Final on 27 November 2016. Celtic also clinched their sixth successive league title on 2 April 2017, with a record eight league games to spare. As Celtics unbeaten domestic run continued, they subjected Rangers to their heaviest defeat at Ibrox since 1915, 5-1, on 29 April. Celtics 2-0 win over Hearts on 21 May saw them finish 30 points ahead of second-placed Aberdeen in the league, with a record 106 points, and the team became the first Scottish side to complete a top-flight season undefeated since Rangers in 1899. On 27 May 2017, Celtic clinched their fourth treble by defeating Aberdeen 2-1 in the Scottish Cup final. The cup final win saw Celtic go through the entire domestic season unbeaten.\",\"question\":\"How many points did Aberdeen have for the 2017 season?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}