{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"20ec172b-aaf1-5257-9fc1-eb3b797d719d","task_key":"default--validation--23c5db2f~2dad5f~2d4464~2daddf~2dc19141fe78d1","task_revision_id":"1","upstream_id":"23c5db2f-ad5f-4464-addf-c19141fe78d1","short_description":"How many years did the Byzantine civil war last?","config":"default","split":"validation","body":"{\"passage\":\"The Byzantine civil war of 1373-1379 was a military conflict fought in the Byzantine Empire between Byzantine Emperor John V Palaiologos and his son, Andronikos IV Palaiologos, also growing into an Ottoman civil war as well, when Savcı Bey, the son of Ottoman Emperor Murad I joined Andronikos in a joint rebellion against their fathers. It began when Andronikos sought to overthrow his father in 1373. Although he failed, with Genoese aid, Andronikos was eventually able to overthrow and imprison John V in 1376. In 1379 however, John V escaped, and with Ottoman help, regained his throne. The civil war further weakened the declining Byzantine Empire, which had already suffered several devastating civil wars earlier in the century. The major beneficiary of the war were the Ottomans, whose vassals the Byzantines had effectively become.\",\"question\":\"How many years did the Byzantine civil war last?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}