{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2161ec2d-ef04-5fa4-8807-9e3e0edb374e","task_key":"default--validation--10a76bc7~2d5704~2d4e74~2db84e~2dc5a40ca2bdda","task_revision_id":"1","upstream_id":"10a76bc7-5704-4e74-b84e-c5a40ca2bdda","short_description":"Which Somali political organizations proposed the independence clause?","config":"default","split":"validation","body":"{\"passage\":\"Following World War II, Britain retained control of both British Somaliland and Italian Somaliland as protectorates. In 1950, as a result of the Paris Peace Treaties, the United Nations granted Italy trusteeship of Italian Somaliland, but only under close supervision and on the condition—first proposed by the Somali Youth League  and other nascent Somali political organizations, such as Hizbia Digil Mirifle Somali  and the Somali National League —that Somalia achieve independence within ten years. British Somaliland remained a protectorate of Britain until 1960. In 1948, under pressure from their World War II allies and to the dismay of the Somalis, the British returned the Haud  and the Ogaden to Ethiopia, based on a treaty they signed in 1897 in which the British, French and Italians agreed upon the territorial boundaries of Ethiopia with the Ethiopian Emperor Menelik in exchange for his help against raids by hostile clans. Britain included the provision that the Somali residents would retain their autonomy, but Ethiopia immediately claimed sovereignty over the area. This prompted an unsuccessful bid by Britain in 1956 to buy back the Somali lands it had turned over. Britain also granted administration of the almost exclusively Somali-inhabited Northern Frontier District  to Kenyan nationalists despite an informal plebiscite demonstrating the overwhelming desire of the region's population to join the newly formed Somali Republic.\",\"question\":\"Which Somali political organizations proposed the independence clause?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}