{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a2847913-a6dc-527f-a1fe-2633f6275171","task_key":"default--validation--fe664559~2df058~2d45fa~2d842d~2d7635d4899958","task_revision_id":"1","upstream_id":"fe664559-f058-45fa-842d-7635d4899958","short_description":"How many more millions, according to a 2008 report, ethnic Turks were there…","config":"default","split":"validation","body":"{\"passage\":\"According to the 2012 edition of the CIA World Factbook, 70-75% of Turkeys population consists of ethnic Turks, with Kurds accounting for 18% and other minorities between 7 and 12%. According to Milliyet, a 2008 report prepared for the National Security Council (Turkey) of Turkey by academics of three Turkish universities in eastern Anatolia suggested that there are approximately 55 million ethnic Turks, 9.6 million Kurds, 3 million Zazas, 2.5 million Circassians, 2 million Bosniaks, 500,000-1.3 million Albanians, 1,000,000 Georgians, 870,000 Arabs, 600,000, Pomaks, 80,000 Laz people, 60,000 Armenians, 25,000 Assyrian people, 20,000 Jews, and 15,000 Greeks, 500 Yazidis living in Turkey.\",\"question\":\"How many more millions, according to a 2008 report,  ethnic Turks were there compared to Zazas?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}