{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"drop","formal_name":"DROP","introduction":"DROP is a reading-comprehension benchmark whose questions require discrete operations over the paragraph — addition, subtraction, comparison, counting, sorting. It is built so that extracting a span cannot answer them.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/ucinlp/drop","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"42a609f4-aae8-5dae-b990-83480175d8a9","task_key":"default--validation--5d52cc38~2d4e19~2d4515~2d9919~2d472331183062","task_revision_id":"1","upstream_id":"5d52cc38-4e19-4515-9919-472331183062","short_description":"How many urban dwellers are in Chişinău, Bălţi, and the autonomous territorial…","config":"default","split":"validation","body":"{\"passage\":\"According to the 2014 census, 1,144,428 residents or 38,2% live in cities while 1,853,807 are rural residents. The largest cities under the control of the constitutional authorities are Chişinău with 644,204 (with 590,631 actual urban dwellers) and Bălţi with 102,457 (97,930 urban dwellers). The autonomous territorial unit of Gagauzia has 134,535, out of which 48,666 or 36,2% are urban dwellers. Ungheni is the third largest city with 32,828, followed by Cahul with 28,763, Soroca with 22,196 and Orhei with 21,065.\",\"question\":\"How many urban dwellers are in Chişinău, Bălţi, and the autonomous territorial unit of Gagauzia combined?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/ucinlp/drop","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}