{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7969083f-2414-5fd9-875d-044f0c40f453","task_key":"default--validation--bb9c2b77~2da530~2d4403~2d82f2~2dca2c18191003","task_revision_id":"1","upstream_id":"bb9c2b77-a530-4403-82f2-ca2c18191003","short_description":"Which year is the latest for a small ceremony held clandestinely in Villalar,…","config":"default","split":"validation","body":"{\"passage\":\"With Spain's transition to democracy following Franco's death, celebration of the comuneros started to become permissible again.  On April 23, 1976, a small ceremony was held clandestinely in Villalar; only two years later, in 1978, the event had become a huge demonstration of 200,000 in support of Castilian autonomy.  The autonomous community of Castile and León was created in response to public demand in 1983, and it recognized April 23 as an official holiday in 1986.  Similarly, each February 3 since 1988 has been celebrated by the Castilian nationalist party Tierra Comunera in Toledo.  The celebration highlights the roles of Juan de Padilla and María Pacheco, and is done in memory of the rebellion in 1522, the last event of the war.\",\"question\":\"Which year is the latest for a small ceremony held clandestinely in Villalar, 1976 or 1978?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}