{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5554138e-6ce6-53e2-ad74-687e3f617f46","task_key":"default--validation--20eba3da~2d6af7~2d494f~2da96f~2d2d84af1b4083","task_revision_id":"1","upstream_id":"20eba3da-6af7-494f-a96f-2d84af1b4083","short_description":"What happened first: king's brothers raised a rebellion or confederation and…","config":"default","split":"validation","body":"{\"passage\":\"Ava's authority deteriorated further in Shwenankyawshin's reign . Three of the king's own brothers openly raised a rebellion in 1501. Mohnyin, Ava's former vassal, now began to raid its territory. In 1507, Ava ceded to Mohnyin all northern Avan territory down to present-day Shwebo in the vain hope that the raids would stop. It did not. Ava desperately tried to retain Toungoo's loyalty by ceding the key Kyaukse granary to Toungoo but it too failed. Toungoo took the region but formally broke away in 1510. Ava's only ally was the Shan state of Thibaw , which too was fighting Mohnyin's raids on its territory. Mohnyin was attacking other Shan states when it was not raiding Ava. It seized Bhamo from Thibaw in 1512 in the east, and raiding Kale in the west. The Ava-Thibaw alliance was able to retake Shwebo for a time but Mohnyin proved too strong. By the early 1520s, Chief Sawlon of Mohnyin had assembled a confederation of Shan states  under his leadership. Prome had also joined the confederation. The confederation wiped out Ava's defences in Shwebo in 1524. Finally on 25 March 1527, the forces of the confederation and Prome took Ava. The Confederation later sacked Prome in 1533 because Sawlon felt that Prome had not given sufficient help.\",\"question\":\"What happened first: king's brothers raised a rebellion or confederation and Prome took Ava?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}