{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"96ccbbbd-bfd0-5d7d-9526-e1039507295d","task_key":"default--validation--b686685b~2d0fde~2d4843~2d88f2~2d0f1aa9c9104c","task_revision_id":"1","upstream_id":"b686685b-0fde-4843-88f2-0f1aa9c9104c","short_description":"How many groups settled on the Circassian lands?","config":"default","split":"validation","body":"{\"passage\":\"Some sources state that three million Circassians were evicted from Circassia in a period lasting until 1911. Other sources cite upwards of two million Circassian refugees fleeing Circassia by 1914 and entering nations and regions such as the Balkans, Turkey, what was the Ottoman Empire in what was known as the Muhajir, Iran, the Qajar dynasty also as Muhajir, Syria, Lebanon, what is now Jordan, Kosovo, Egypt , Israel  and as far afield as upstate New York and New Jersey. Some 90 percent of people with Circassian descent now live in other countries, primarily in Turkey, Jordan and other countries of the Middle East, with only 300,000-400,000 remaining in what is now Russia. The depopulated Circassian lands were resettled by numerous ethnic groups, including Russians, Ukrainians and Georgians. Friction developed between the latter group and the remaining indigenous people in Abkhazia, a factor later contributing to friction between the two ethnic groups and the resulting War in Abkhazia.\",\"question\":\"How many groups settled on the Circassian lands?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}