{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"952180f9-31b6-5c8d-b8f2-756d240279ab","task_key":"default--validation--6ebee2d1~2d4f22~2d4d84~2daa07~2d5bc7285f7c6d","task_revision_id":"1","upstream_id":"6ebee2d1-4f22-4d84-aa07-5bc7285f7c6d","short_description":"A Portuguesa was proclaimed as the national anthem how many years after the song…","config":"default","split":"validation","body":"{\"passage\":\"On 19 June 1911 the National Constitutional Assembly proclaimed A Portuguesa as the national anthem, replacing the old anthem Hymno da Carta in use since May 1834, and its status as national symbol was included in the new constitution. A Portuguesa was composed in 1890, with music by Alfredo Keil and lyrics by Henrique Lopes de Mendonça, in response to the 1890 British Ultimatum. Because of its patriotic character, it had been used, with slight modifications, by the rebels of the 1891 uprising in a failed attempt at a coup d'état to establish a republic in Portugal, an event which caused the anthem to be forbidden by the monarchic authorities.\",\"question\":\"A Portuguesa was proclaimed as the national anthem how many years after the song was composed?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}