{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6069af44-061b-547a-bc2d-c7010a2e454c","task_key":"default--validation--d5d1b28c~2d30e6~2d44df~2d9f14~2d42f7bfc86ea8","task_revision_id":"1","upstream_id":"d5d1b28c-30e6-44df-9f14-42f7bfc86ea8","short_description":"How many years was the capital of China, Republic of China?","config":"default","split":"validation","body":"{\"passage\":\"During the early reign of the Yongle Emperor, the territorial princes were restored of their positions. However, they were relocated away from the frontiers, and gradually stripped of their military power. With the subsequent policies enforced by the Yongle Emperor, the emperor was successful in consolidating the power of the central government. In 1426, the Xuande Emperor managed to force all of the territorial princes to renounce their remaining personal army after suppressing the rebellion of Zhu Gaoxu. The Yongle Emperor began the preparation for relocating the imperial capital to Beiping in 1403, a process that lasted throughout his entire reign. The construction of the future Forbidden City along with the restructuring of the Grand Canal were constantly ongoing. In 1420, the reconstruction of Beiping City was completed, and the Ming Dynasty officially relocated the imperial capital to Beiping and renamed the city to Beijing. With the exception of Republic of China between 1928 and 1949, Beijing remains to be the fixed capital of China ever since.\",\"question\":\"How many years was the capital of China, Republic of China?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}