{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a8ac337c-0c16-50ac-af07-57e4a6c8fa77","task_key":"default--validation--f3becd47~2dc187~2d494d~2d932b~2d5eddbaa3f525","task_revision_id":"1","upstream_id":"f3becd47-c187-494d-932b-5eddbaa3f525","short_description":"Who did Andronikos IV Palaiologos team up with against his father?","config":"default","split":"validation","body":"{\"passage\":\"The Byzantine civil war of 1373-1379 was a military conflict fought in the Byzantine Empire between Byzantine Emperor John V Palaiologos and his son, Andronikos IV Palaiologos, also growing into an Ottoman civil war as well, when Savcı Bey, the son of Ottoman Emperor Murad I joined Andronikos in a joint rebellion against their fathers. It began when Andronikos sought to overthrow his father in 1373. Although he failed, with Genoese aid, Andronikos was eventually able to overthrow and imprison John V in 1376. In 1379 however, John V escaped, and with Ottoman help, regained his throne. The civil war further weakened the declining Byzantine Empire, which had already suffered several devastating civil wars earlier in the century. The major beneficiary of the war were the Ottomans, whose vassals the Byzantines had effectively become.\",\"question\":\"Who did Andronikos IV Palaiologos team up with against his father?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}