{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"471b0e29-6be2-573b-9cba-a43c67103271","task_key":"default--validation--e89120ea~2dcea6~2d453d~2db3a8~2dd72051107987","task_revision_id":"1","upstream_id":"e89120ea-cea6-453d-b3a8-d72051107987","short_description":"How many years was Hymno da Carta the national anthem of Portugal?","config":"default","split":"validation","body":"{\"passage\":\"On 19 June 1911 the National Constitutional Assembly proclaimed A Portuguesa as the national anthem, replacing the old anthem Hymno da Carta in use since May 1834, and its status as national symbol was included in the new constitution. A Portuguesa was composed in 1890, with music by Alfredo Keil and lyrics by Henrique Lopes de Mendonça, in response to the 1890 British Ultimatum. Because of its patriotic character, it had been used, with slight modifications, by the rebels of the 1891 uprising in a failed attempt at a coup d'état to establish a republic in Portugal, an event which caused the anthem to be forbidden by the monarchic authorities.\",\"question\":\"How many years was Hymno da Carta the national anthem of Portugal?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}