{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3721fd1d-22a2-5ed3-b92b-1ae6a8ba0741","task_key":"default--validation--24b74e17~2d31c6~2d450c~2d9b77~2d7e6c8519f703","task_revision_id":"1","upstream_id":"24b74e17-31c6-450c-9b77-7e6c8519f703","short_description":"How many more times did the Synchronicity album go platinum between 1984 and…","config":"default","split":"validation","body":"{\"passage\":\"The Police had six top ten hits on the Billboard Hot 100 during the first half of the 1980s, with one of those top ten hits, \\\"Every Breath You Take\\\" peaking at 1 number on the Billboard Hot 100 in 1983. During that time, the bands songs \\\"Spirits in the Material World\\\" and \\\"Synchronicity II\\\" peaked at number 11 on the Billboard Hot 100 and number 16 on the Billboard Hot 100, respectively. The Polices album Synchronicity (The Police album), released in June 1983, was certified 4x platinum by the RIAA on 14 November 1984 and was later certified 8x platinum by the RIAA in December 2001. The Polices album Ghost in the Machine (The Police album), released at the beginning of October 1981, was certified platinum by the RIAA less than 3 months after being released. The album was certified 2x platinum by the RIAA in November 1984 and was certified 3x platinum by the RIAA in December 2001. The Polices album Synchronicity peaked at number 1 on the Billboard 200 on 23 July 1983. Synchronicity was at number 1 on the Billboard 200 both from 23 July 1983 - 3 September 1983 and from 17 September 1983 - 19 November 1983.\",\"question\":\"How many more times did the Synchronicity album go platinum between 1984 and 2001?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}