{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"481b7e62-a9d4-537e-bf4d-6e33b3929442","task_key":"default--validation--a4d4e56f~2dad19~2d4709~2db23d~2deb3cc6e63273","task_revision_id":"1","upstream_id":"a4d4e56f-ad19-4709-b23d-eb3cc6e63273","short_description":"How many losses did Celtic have in the 2017 domestic season?","config":"default","split":"validation","body":"{\"passage\":\"On 20 May 2016, Brendan Rodgers was announced as Deilas successor. Despite a Lincoln Red Imps 1-0 Celtic, his first season saw the team go on a long unbeaten run in domestic competitions, during which time the club won their 100th major trophy, defeating Aberdeen F.C. 3-0 in the League Cup Final on 27 November 2016. Celtic also clinched their sixth successive league title on 2 April 2017, with a record eight league games to spare. As Celtics unbeaten domestic run continued, they subjected Rangers to their heaviest defeat at Ibrox since 1915, 5-1, on 29 April. Celtics 2-0 win over Hearts on 21 May saw them finish 30 points ahead of second-placed Aberdeen in the league, with a record 106 points, and the team became the first Scottish side to complete a top-flight season undefeated since Rangers in 1899. On 27 May 2017, Celtic clinched their fourth treble by defeating Aberdeen 2-1 in the Scottish Cup final. The cup final win saw Celtic go through the entire domestic season unbeaten.\",\"question\":\"How many losses did Celtic have in the 2017 domestic season?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}